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I Summary , of Findings and Their Implications 



•The major findings of the Evaluation Report of 
ECE, ESEA Title /. a19d EDY. 1 975-76. which are 
summarized below, are^organipij in this part as- 
they appear, in Part V of-^ r^jort: enumeration 
data on participants in EC^^^^SEA Title I, and 
EDY; institutional change; and student achieve- 
ment/ The implication of these findings for 
De^Tartment of Edu<5ati((p action are reviewed 
briefly at the end of this ^mmary . 

Enumeration, Data on Participants 

An. examination .of the participant reports for 
early childh6od "education ^ECE), Title I of the 
Elementary and Secondary Educa^on Act (ESEA). 
and educationally disadvantaged youth (EDY) pro- 
grams indicate.d the following: 

• More than 939'000. students were served 
through the combined fiinding sources in 
1975-76. Sixty-eight percent qf, these students 
were enrolled in kindergarten through^ade- 
three (ECE, ESEA Title I, and EBY); 23 
percent were enrolled in grades four through 
six (ESEA Title I and EDt); and 9 percent 
were enrolled in grades seven through twelve 
(ESEA Title I and EDY). 

• More students received services in reading and 
mathematics than in any other component. 
More than 883,500 students were served in 
reading, and more than 849,500 students 
were served in mathematics. 

• More adult volunteers were involved in school 
programs than ever before. The 81,505 idult 

, volunteers contributed nearly 35I,000*hours 
per week of program assistance, ^ average of 
4.3 hours per week per volunteer. Of these 
volunteers 76 percent (61,840 persons) partic- 
ipated in ECE schools, while 24 perpent 
worked in schools with ESEA Title I and/or 
EDY^rograms only. 

Institutional Change in Participating Schools 

Evidence of institutional change in -scheols 
participating in the ECE reform effort and in 

2—75671^^ 



ESEA Title I and/or EDY was gathered from the 
quality ratings of school-level plans, from quality 
reviews conducted during the monitor and review. 
(MAR) school visitations, and- from the special 
surveys of,, specific dimensions dT institutional 
change. ' Institutional cTiarnges irt, participating 
schools were evident from the foUoN^'ing findings 

• 'T^e plan-rating information indicafed that all 
participating schools were engaged in system- 
atic planning, 

• The monitor and review (MAR) data indi- 
cated that: * ^ 

r, ECE schools were rated very high on 
/^plementation of their programs in accor- 

/ dance with their school plans (average 
mting 3,9 out of 5), especially in the^ areas 
of reading and mathematics ftistrucition. ' 

2. Non-ECffi schools that .received only cate- 
gorical resources werel^ rated hi^^ 9n 
implementation of their projgramsin accor- 
dance . with their school plans (average 
rating 3:6 out of 5). 

3 . EC£ schools were ' rated high on their 
progress toward involving parents in all^ 
phases of the school program (average^ 
rating 3.6 out of 5). 

fai formation gathered through the^/ special sur- 
^v^ys indicated that j . - . . 

Parents in the schoolsVlRat were, surveyed 
Y w^r^ ^^^^^^^ ^^^^ performance* of their 
i children/with availaljle schbo^ resources and 
materials, and with their role in the« school 
prbgram. They also believed- that parent 
involvement had a beneficial effect on their 
children's attitudes toward school. 

• Teachers in the schools ' that were surveyed 
felt that implementation of individualized 
instruction was taking place with relatively 
few constraints. Also, nearly 60 percent 
judged the recordkeeping as helpful in carry- 
*ing out an individualized prdgram. 



These, higlilights, well as other' findiiigs, 
s stronglyundicated that ECE schools were in it iatijig* 
and refining major changes in many of their v'*^ 
programs. They 'indicated that pCE schools were V 
effecting basic in stit^ition al ghapges in/ systematic ' 
program planning, implementation, and evaluation. 

Three areas of institutional effectiveness a'ppear 
to requi^ increased emphasis in the coming year: 

1 . SdTt>ol-plan-rating data indicated the need for 
improved app>roachesi to meet the n^ds of 
iTmited- and 'non-English-speaking' students 
and the need for improved program planning 
in the area of language development. 
2. The monitor and review data incjicated the 
need for further emphasis on effective imple- 
^ mentation of language development activities. 
, 3. The monitor and review data also indicated 
the freed for additional attention to methods' , 
of, involving parents in program evaluation 
activities. - . . 

. Student Achievement 

Distric t-rep6rted data from standardized, 
nationally-normed tests indicated that: 

• Students in schools .with ECE funds only or 
ECE funds in^ eonlbination with ESEA Title 
and/or EDY funds a"ttained reading achievfjllp ^ 
ment scores above the national average in all 
grades served. On the average, students in 
ECE-dnly schools exceeded the national aver- 
age on post-tests of reading achievement by * 
2.9 to 3.8 standard score points. • 

• Students in ECE schools tended to have- 
higher gain scores in reading and mathematics 
achievement than did students in schools \vith 
ESEA Title I and/or EPY programs only. 

• Studerit^. schools with ECE funds only or 
ECE fun^in combination with ESEA Title I 
and/or EDY funds -attained mathematics 
achievement scores above the national average 
in all grades served. On the average, students 
in ^CE-dnly schools .exceeded the national 
average on post-tests of mathematics achieve; 
'ment by 2.7 to 53 standard score points. 

. • jStudj^ts in schools receiving only ESEA Title 
I and/or ^Y funds demonstrated consis- 
» tent movement toward the national no?)n in 
reading and mathematics achievem^t in 
grades one through four. 

Cahfornia Assessment Program (CAP) dat« on 
reading achievement . in grades two and three 
showed that: ^ 



• . • * Irj . sc^iools*' receivii)g ECE . f^frtd^.^jU:^ 'ivni 
schools reyeiviog ECE funds'" in coipbin'ation' 
•with E^Ei\. Title I and/or. EbY Tunds^ stu- 
dents showed greater gains in*readjng acfhieve- 
ment from 1974-75 to 1975-76 than students 
in a similar group of non-ECE schools 
showed. . - - 

• Students in ECE schools showed greater gains 
in residual reading acliie/ement scores from 
grade two to grade three than dfd students in 
non-ECE sfehools.* 

• Longitudinal declines in average residual read- 
ing achievement scores were noted inMhe 

, group of ECE schools whose students scored 
\x\ the lowest 20 percent on the CAP t:ntry^ 
Level Test. *niis finding suggests the need for 
more intensive analysis-^f all available data 
relajttd to schools within this group, rigorous 
special surveys of student background and 
school factors^ that may be^ contri^)uting to 
these declines, and other appropriate pirogram 
improvement, efforts to assist schools in 

. improving students' reading* performance. 

.Implications^'or Department 
, ' X of Education Action 

" As indicated throughout this report, the Depart- 
ment of Education is nwking every effort tb 
improve the quaUty and u^efulness.of monitoring/ 
and evaluation, information through « continual 
refinement of procedures, instrum^ntafioiu, and 
analvjfe^echniques. Among the refinements hntici- 
pate^ foX the 1976-77 consolidated evaltation 
report wiljfbe the following: 

• A limited number of rigorous special surv^eys 
will focus on the studerit and school charac- 
teristics that affect reading achievement. ' 
These special surveys will address questions 

.such' as those raised in Part V about the 
' performance of schools in the lowest 20"* 
. percent on the Entry Level test 

• As noted in Part IV, numerical ratings of 
school plans have been discontinued in favor * 
of specific feedback dn the strengths and - 
weaknesses of individual plans^ ^ . ^ f 

• Efforts to provide^useful longjtf dinafdata on 
the performance of schools and students will 
be continued. 



A residual score is defined as the difference between a schooPs 
actual score (average score pf its stiidepts) and iXs predicted score. 
Predictvl scores are statistical estimates based on background 
characteristics of Uie school and its students. 



A • KlTorts to enhance the usefulness of Califor- 
• nia Assessment Program (CAP) data in assess- 
ing student, performance in schools teceiving 
reform funds and categorical funds will be 
contin.ued. ' . . \. ^ 

As in 1974-75, tlte. l>jpa^triient en^io^ny&red 
many problems in trying to. assess tfie progress of r 
limited- and, non-l:nglish-speaking studont^.' 'Wtese- 
problems were caused by a lacjc of 'appropfiare'l: 
testing instruments. Development of.such instru: 
ments is continuing through a series of cohtracti^ i 



with private research lirms, but the instrum^ts are 
not, scheduled for coihpktion until late in I9'77. 
Thus, the same pretest and post-test performance 
assessment limitations wijl exist for the 1976-77 
report. ^ 

In accordance with SB 1698/76. the 1976-77 
Vvafuation report of LCi:, KSKA Title 1. and liDY 
will 6ij. expanded -To incjude data on, the Miller- 
Unrv^l heading program and' dat.fS^n^ the state 
program for limited- and non-1- njlish-speaking 
students/ • ^ ' . 
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lljniroduetion to the Report 



This Evaluation Report of ECE, ESEA Title I. 

\and EDY. 1975-76 is designed to provide a 
description and interpretation of the effects of 
local school programs, supported by early child- 
hood education (ECE) funds, funds provided under 
Title I of the Elementary and Secondary Education 
Act* of .4 965 (ESEA Title I), and educationally 
disadvantaged yguth (EDY) funds in the 1975-76 

^^ool year. Although ECE, ESEA Title I, and 
EDY represent separate funding source^, their 
administration is designed to achieve a consistent, 
process of systematic program planning, irnp'"^ 
mentation, and evaluation it the district 
school levels. 

. This comprehensive approach to progTcuu y 
' improvement reflects the cooperative e/forts of ^ 
Legislature, the St^te .Board of Education, and 
Department of Education t(i develop an edu 
tional system that is designed to provide a quali 
educational program for all students in Califomi 
These efforts incorporate three dimensions: (1) thfc 
movement toward ac> equitable base level .of school 
support that lessens the disparities in wealth among\ 
districts; (2) the recognition that various levels of \ 
support and assistance are required to meet the 
special needs of such students as the educationally 
disadvantaged, limited- and non-English-speaking,*^ 
and physically and mentally exceptional; and (3)\ 
the provision of support and encouragement to ; 
ensure that funds and program improvement \ 
efforts to meet the Unique ^ucational needs of ^1}/ 
students are coordinated through a plan*iiTg, 
implementation, ''and ^valuation process at^ch 
school site. 

To encourage the coordination of these funding 
sources at the district level and at school sites, the 
Department, in accordance with Assembly Concvtr- 
rent Resolution. 127' of 1969, developed and 
implemented a consolidated application approach 
in 1973-74, For kin'dergarten through grade three. 



ECE provides the framewofk ip enable school 
staff, parents, and representatives of tHfe commu- 
nity at each school site to join together to plan, 
implement, and evaluate programs designed to 
promote educational' improvement at that school. 
Thus, the consolidated application and ECE pro- 
vide a joint process for managing resources to 
effect comprehensive program improvement for alt 
students in kindergarten throu^ grade three. 

Consistent with the overall approach described 
abQve' this n^drt not only presents information 
about thei implementation of ECE, ESEA Title I, 

' and' EDY, but it also, reflects the relationships 
between thp comprehensive program improvement 

. efforts of early childhood education and thfe 
various state and fedel^al efforts directed towarcf 
the special needs of ediicationally disadvantaged 
students. 

This evaluation report includes de^^scriptions bf 
ECE, ESEA Title I, and EDY; the methodology, 
\instrumentation, and limitations of the various 
\^ data-colkction and data-analysis procedures; and 
\ the findings of the evaluation. Descriptions include 
\the goals, legislative authorization, scope, and 
\eligibility criteria for each funding sour^cvTJie 
''methodology section contains a description oftthe 
procedures that >yere followed and the instru- 
mentation, that was used. The findings section 
contains information about the numbers and types 
of -parti cipafnts'j expenditure patterns, indicators of 
institutional change, and student achievement 
results. Finally, since some ESEA Title I funding 
administered directly by various state agencies was 
used to serve distinct groups of students in 
specialized programs, a separate section is devoted 
to thoife programs, 
/ In addition to this report, a separate appendix 
contaiJ^ing an exhaustive compilation of all the 
source d^ta' is available from the Department of 
Education . ^ . r , 



9 



J 



L Program Description 



Part IJI of the evaluation report gives the reader 
a background a^nst which to examine the effects 
. of schoot programs supported by ECE, ESEA Title 
I, and EDY. U also provides an overview of the 
goals, legislative authorizations, scope, and eligibil- 
ity criteria for /each funding source. 
/ / . 
E^ty Childhood Education 

Early childhood education (ECE) was enacted 
by Chapter ]\ 47 , Srftutes of 1 072. This legislation 
established t process^ to reform and^ Where heces- 
sary, restructure primary education in California to 
ensure thajt all students in kindergarten through 
grade three would receive an education that would 
meet the^ unique needs\ talents, interests, and 



abilities 

To 
comprel 
site to 
appropi 
results 
be ne< 



thieve - this goal, ECE calls for a 
5n$ive process at each elementary school 
S9ess the needs of the students, develop 
k|!e educational strategies, evaluate the 
and make anj^ subsequent changes that may 
sary. Each of these steps is to involve the 
joint (bfflorts of parents, teachers, administrators, 
other/sqhool staff, and members of the commu- 
nity./ Although the areas of emphasis and the 
approaches to program improvement are . neces- 
sarily differtnt at each school, these six major 
strategies are emphasi^ed^in every ECE school: 

. individualization of instruction to meet each 
ibhild*s capabilities ahd needs, with ongoing 
Attention given to the child's progress' 
. .Organization of the learning experiences to 
allow ea^h child to make continuous progress 
at his.^ her own rate arid to develop positive 
attituqes and feelings of self-worth 
. Reduction of the child-tO:^dult ratio to not 
mort than 10 to 1 throughtp^e use of parent 
volunteers, aides, and tutors ^ 
. Provision of support programs, such as parent 
educa)i(on, hcalth/au?ciliary services, and strff 
development . ' ^ 



5. Development of active school-parent commu- 
. nity partnerships through cooperative pro- 
gram planning and implementation efforts 

6. Development of a school site evaluation to be 
used for refining program plans and imple- 
mentation activities 

The goal of ECE is to incorporate the strategies 
described above as a means of improving locil 
instructionii program^ and . estaiblisjiing* account- 
ability ai each participating schooly'As a compre- 
hensive restructuring process aimed at all students 
in kindergarten through grade three within a 
participating school, ECE ^s not designed to be a 
categorical prQgram;^that is, it is not designed to 
provio^e supplementary resources to improve the 
perfon^ance of identified groups of students with 
special heeds. Iristead, ECE is designed to proyide 
the fraAiework and resources for designing school 
propwis th^Will meet the needs of all students in 
that schbol. 

Scope of ^ 

Chapteir 1 147, Statutes of 1972, provided for an 
appropriation of $15 million in 1973-74 and $40 
million ih 1974-75 for support of ECE. Since 
J 974-75 ECE has been expanded annually throu^, 
funds prcividcd in the state budget. As is shown ui 
Table III-l, the 1975-76 state budget provided for 
$63.2 million for the support of ECE. These funds 
ext^ded the ECE effort to approximately one- 
third of California's student population in kinder- 
garten through grade three. Table III-l also re fleets 
the expansion of ECE from school year 1974-75 ' 
through the 1976-77 school year. 

ECE Funding and Eligibility Criteria , . ) 

Upon State Board of Education approval of a 
, school's proposed program, ECE funds were allo- 
cated in 197^-76 on the basis of $>4l0 per student 
enrolled in kindergarten through ^de three. An 
additional $70 was allocated for each studentVho 
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scored at or below the 25tk percentile ot national 
norms in reading or mathematics achievement. 

liach year half of the KCI: funds for any 
D{irtici^ating district must be used at those schools . 
that have thc^ greatest "educational need/' Tbe 
measure of educational need is the percent or 
number of students scoriifc at or below the 25th 
peniiientile on standardized, nationally normed 
reading or mathematics achievement tests. The 
other half of the HCH funds may be used for ^any 
combination of schools that/fhe: district selects, 
since alJ schools are eligible for funding. 

TABLI-: II M 

Number of K-3 Students Served by BCt and!t^unds I 
Appropriated. 1974-75 Through 1976-77 ^ 



Nufiibcr ol 
K-.^ sUkIcjUs 
scrvcil 

(i7(k()(K) 
(estitnjtcd) 



55 

U'MifDJted) 



I* unds 
;ippri)priJtcd 

^)7.450.O()0 



The annual expansion of ECE to additional 
schools is based on the availability of* new state 
funds and the quality of programs implemented at 
ECE schools iir each participating district. As a 
result, in any given year expansion rates vary from 
district to district, with some districts reqeiving no 
expansion funds at all. 

ESEATitlel 

.In enacting Title I of the Elementary and 
Secondary .Education Act (ESEA) of 1965 (PL 
89-10, as amended), the United States* Congress 
provided financial assistance for the augmentation, 
of educational programs for st^jjents from tow- 
income fariilies. Pursuant to fede"ral statutes the 
Department of Education allocates and' monitors 
grants of money to local educational agencies 
qualifying for ESEA Title I funds. 

Scope of ESEA title I 

Table III-2 displays the number of students 
served by ESEA Title I and the funds appropriated 
from 1974-75 through 1976-77. 

ESEA Title I Funding and EUgibOity Criteria ^ 

, ESEA Title I funds are granted to California on 
the basis of the eligibility of each cou/ity. Funds 



art then allocated to school districts in accorihncc 
with a formula based bn data from Xhc Aid to 
Fa mil ics with Dependent C hildren (Af'IX ) pro* 
gram. Tlie formula is sliown in Appendix A. 
I>istricts then allocate funds to target schools on 
the basis of relative educational need. 

Once HSFA Title I funds are allocated to a 
school, students are selected for participation on 
the basis of their educational *need, which is 
defined to include students Coring at or below the 
second quartile on standardised achievement tests 
or those who have serious learning deficiencies 
because of linguistic, social, cultural, or economic 
isolation. ♦ ^ , 

In their use of ESHA Title. I funds, districts, must 
provide services to participating jitudents over and 
above the services that they provide to nonpartici- 
patii\g students. Wbile ESEA Title I funds maV- be 
used for students in preschool and in kindergarten 
thrOugli grade twelve, state regulations require that 
these monies be **focused" first on students in the 
early school grades to make the greatest impact 
early in a ctuld*s education. . 

TABLE III-2 

Number of StudenU Served by ESEA Title f and Funds 
Appropriated, 1974-75 Through 1976 77 





Number ot 


1 




students served 


Funds 


Vejr 


( j11 grjde levels) 


appropriated* - 




503,4I6** 


S1J2.S77,01.S 






■ l-^0.63<),4:o 




550,000 


I>?.H80,257 




^estimated) 





*AU TigUrM in this column represent imounts appropriated to local 
educational agencies (LEAs). Fhese amounts do not include funds 
allodtfcd for migrant educatij^t. handicapped children, neglected 
and delinquent.children. or other purposes because the counts of 
participants are limited to students receiving funds granted to 
LEAS. 

••Ii> the Evaluation Report of tCE. kSEA Title /. and EDY, 
1974-75. the number of Title I participants reported (591,56]) 
represented a count of all^students in schools that received Title I 
funds, l-or fiscal year IS75-76 the sumnury count reflects- the 
actual number of studenti who participated in Title I prograrrw, 
So that the figures ^wn are comparable, the number of students 
scrve<f by Title \ if fiscal year 1974 75 has been restated to 
reflect the actual number of students wtm participated in Title I 
prografns. , / , • . ^ 

Othet special categories of 3tuder>t« who are 
eligible to receive services under ES^A , Title I 
include handicapped students Hvingii) 'state institu- 
tions, American Indian and migrant students. 
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Students in state institutions lor the neglected or 
delinquent, and students attending tu)npublic 
schools if they live in an eligible attendance area 
and are educationally deprived. 

Educationally Disadvantaged Youth 

The stttte-tiinded program tor educationally dis- 
advantaged youth (liDY) is designed to provule 
()uaUty educational opportunities tor students, as 
authorized by Chapter 1406, Statutes of 1072 (SB 

The goals, target population, and reqwirements 
'of EDY ^re similar to those of HSl'A litle I 

Scope of EDV * 

Table 111-3 displays the number of students, 
served by EDY ^nd the funds apF^ropriated from 
1974-75 through 1976-77. ^ 

Fonding and Elipk>llity .Criteria • 

Educationally disadvantaged youth (EDY) funds 
are allocated to school districts in accordance with 
a ToiTnula that includes indexes of limited-English- 
speaking ability, transiency; and -poverty.' The 
(orrnula is given in Appendix B, 

Once district eligibility for EDY funding is 
established, districts select those school attendance 
^areairf]' that include the students Wifh the greatest 
educational need. Need is determined by either the 
number or percent of students scoring below-<hej 
25th percentile on standardized achievement tests 



in rradirig or niatheniatics; however, even thougli 
the focus ot attention i^ on students achieving at 
levels below the 25th percentile/ all students 
achieving below the f^Dih percentile are served. 
Under provisions of the lUtucationally Disadvan- 
taged Youth Act, EDY funds are used to serve only 
those students enrolled m public education pr6- 
granis. Regulations establljJhed by the State Board 
of Education require that priority be given to 
serving students in the early grades. 

' TABLl ni-3 

Number «f Students Served by El)Y and Funds 
Appropriated. 1974 75 Through 1976 77 



\ oat 



p)7(.'77 



Nutnher ul 
stiulcnls served 
(all niade levels) 

4(H),7S4 

44V(XK) 
(esiimaicd) 



rounds 
approptiafcd 

,7S4,0()0 
»)7,.S.S4,9.U> 



•In the tvaluation Report of ECt:, k'SEA Title and t'DY. 
1974^75, the number of EDY puticipanti reported (436,009) 
represented a count of all itudehti in Khooli thil received ^(7Y 
fundi. For fUcal year 1975-76 the lummary count reflects the' 
actual number of studants who participated in EDY programs. So^ 
that the figures shown are comparable, the number of students 
served by EDY in fticai year 1974-75 has been resUted lo reflect 
the actual number pK ftudenta whoiptftkipated in EDY programu 
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IV. P^ace;d^re5, Instrumentat and Wmitations 



An examirtation of the^^^eff^ls of ECE, ESEA 
Title I, and EDY iocused'cH^tnre^ areas: 

• -Enumeration "agf^a' describing the scope t)f 
schodl programs provided through the three 
funding sources^ • > - - ; /'^ 

• • Institutional change incUcators that describe 
the impact of^school restructuring efforts oji 
the context .in which^^ student achieves 

!t Indicators of student achievement '•in reading 
aird mathematics . * ^ 

Conclusions based on a review of Enumeration 
d^ta alone, of the, institutional change d^ta alone, 
or of student/aciiievemenirdata alone" could be 
significan.tly mi^leadiijg. Thus, this report is based 
on a series of measurements or examinations of the 
•jtreas described above, llie evaluation is, therefore, 
a collection of sepaAte Evaluations, which together 
provide a picture of the bfif^cts bfjECE/ESEA Title 
I, and EDY. - • > / ^ - ^ ^ 

Several specific data sourg^/ were used in^the 
evaluation of programs that received; ECE, ESEA 
Title I, or EDY funds. While part of the informa- 
tion w^s used to determine participant eligibility, 
another part was used libr iehool-, district-, and 
state-level planning, and evaluatioji. Chart- IV-1 ^ 
shows the various data sources that were used in " 
the evaluation of programs. These data sources are 
described in^ terms of (1) the funding sources that 
• were- invohred af'^thg^local educational agency; (2) . 
theSiiitrrre of the instrument that was used to gat)ier 
the dka; (3) the agency that completed the 
instrument; and (4) a general, description of the- 
instrun^ent*s^ontents. ' v • 

Enumeration Data on Participants 

Through the year-end "Product Evaluation 
^Report,'* all participating schools. 'were asked[ to 
provide information relative to the numbers of 
participants who received se&ices provided under 
each funding source, the numbers of volunteers 
involvc^d in their programs, and the number^ of 
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personnel hired through the various ; fixncling 
sources. Self-reporting of enumeration data -has 
proved. ^uite accurate and useful in describing the 
scope df school programs. " 

Assessment of Institutional Change 

As noted earlier, a major goal of the 
restructuring effort is to improve thp educational 
delivery system and thereby: increase studeSnt 
'achievement in basic skills. In most cases- such 
improvement inquires, ijistitutional changes that 
affect the goals, roles, and environment of partici- 
pating districts, schools, stafifs, and communities. 
. Designihg instruments and procedures tb assess 
precisely the nature 'ahd degree^ of institutional 
change within and across thousands of schools 
statewide is a difficult task. In the first place, the 
. development of measuring instruments for this 
. purppse involves a relatively new t^hnology. 
Secondly, when assessment procedures ^gpre of 
iiecessity combined with field services and program 
improvement efforts, the assessment of institu- 
tional change may be somewhat conf6unded by 
the companion efforts to improve* programs. 

The Department of Education hias been using 
^ three methods to examine the nature and extent of 
45i$titutional change: (1) quality reviews of school 
^.program plans; (2) on^ite program quality reviews 
for schools entering ECE in 1975-76 and contin- 
uing ECE schools with the lowest overall ratings 
and compliance anff quaUty reviews for schools 
funded.by ESEA Title I and EDY only; and (3) 
special surveys of particular aspects of institutional 
change. 

The quality review of school pi'ogram plans and 
the on-site monitor and review process have several 
^ m^yor purposes. They are intended to provide 
* systematic feedback tb a school about its program 
planning, implementation, and evaluation. This 
/feedback is designed to aid in future program 
/development by encouraging ongoing planning, 
•internal monitor and review^ arid process and 
product evaluation.. 
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^ * CHART IV-l 

; ' Data Sources Used in the Evaluation ofsECE, ESEA Title I, ' ^ 
y: and EDY Programs, 1975^76 



Local educalionaf'agencies 
' * ^ investigated '\ 

. • ■ — — 


ln8tniment(s) used to 
gather data , 


AgerK-y completing 
instrument 


Qescfiption of instrument's 
^ contents 


• • * 

L/ISiriClS Willi CV'C, C^C/\ 

.Title!, or EDY funding 
• 




uKiriti OMite . 


District-level allocation 
plans, application for 
funding >^ \ ' 


tlcmentary and secandary 
y sell (vols wiilj liCli, LSI- A 
l itlc 1, i)r LDY lunding* 

Elementary schools with 
' ECE and/or ESEA ' ^ . 
Tide I/EDY funding 


l/orm A-127ES 
iForm A-127Sec (school 
K;y^ plan) 

School-level plan 
rating instrument 


' Schools ^ 

State Department 
of Education 


School le.vel plans: review 
of needs assessment process^ 
objectives, activities, " j " 
evaluation, disseminaiJion, \ 
and budget ' / ^V,,^^^ 

Rating of sG^ooMevel 
plans 


Selected ECE, ESEA Title l; 
and EDY schools 


Program Quality Review 
Instrument (monitgr and 
review) 


Statp Department 
. of Edg^tion 


On-site review and rating 
of programs' implementation. 


Selected ECE schools 


CalifoiYiia Assessment 
Program Redding Test- 
second and third grades' 


Schools 


State testing instrument used^^ 
>t to ifssess reading achievement* 
. at-the end of grades one and two 


Elementary and secondary 
, schools with EGE,4*SEA 
Title I.o/EDY funding 


Phase 1, evaluation report 
. (Form E-127P) 


Schools 


Evaluation report: enumeratiqn 
of pupils, program personnel;' 
and volunteers: pupil achieve- 
ment' on standardized tests 
(pretest and po.st-test): and 
self-reports on activities^imple- 
mented and objectives 
accomplished ' 


Stratif ied random sample of 
schools with ECE, ESEA Title 1, 
or 1;DY funding 


Pliase 11, special 
studies 


Schools 

If 
* 


Survey instrument report jn one 
of the following: secondary 
schools, adults in the class- 
room, parent involvement, 
decision making, achievement 
reporting, staff development, 
individualization of instruc- 
tion, school advisory commit-' 
tees, multicultural programs, * 

-'and state preschool "* 


Districts with ECE, ESEA 
Title I, or EDY funding * 


FormCARM 10 


District -office 


Financial report for each 
program: ECE, ESEA Title 1, 
and EDY . ^ 
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QuaUty RcvieW of School-Levd Plans 

• T&e' 'Quality review of schoowjbvel plans is 
important for two reasons: (1 ) it produces valuable 
■ data; aijd (2) it encourages the use of a comprehen- 
siya plailning process ^at the x^hgoji site. At the 
.be^nihg of th^ process, Ih^schoiDl cohimunitj^ 
prepares a . comprehensive p^gran} .|)lari. This plan 
is submitted to the Department of Education, 
which carefully reviews it. The equality reviews are 
then sentiyto the schools t'5^ hejlp those who 
prepared theta undersj;and \yeaknesses*in the origi-, 
nal program design. / ' 
.DuriQg the spring^of 1 975, each kchogl applying 
^ for ECE, ESEA Title I, or EDY. funds developed a 
school-lev^l plan/ All schools thaf were applying 
for EGE fund^ submitted theii; plans, to the 
Department pfhducation prior to July 1 , 1 9^ 
. The Department's rating of plank covered s^v^j^al, 
aspects of'.pfogr^m planning, incl,xiding the needs 
' ;assessmei)t process, which includfed identification 
, of existmg conditions and desirejl conditions; the 
' program description, which inclulded specification 
of o^ectives; evaluation and dissemination; and 
program budgeting. The ratink pf the plans pro- 
vided a measure of the ways (fnjwliich systematic 
f |>l'anhing could be put onTpaWr. The rating was 
/not, however, a rating of ^ the ^hools' 'ability to 
^ implement.theirt>lans. / ' 

Program Quality Review an^rogramf^ 
Compliance Review \^ ' i \ 

The purpose of monitor and review (MAR) visits 
is to conduct school-level compliance reviews and 
quality assessments of pfogr^m iniplementation. 
These reviews and assessments sertre two major ^ 
purposes. First^ they providevgartjinpating schools 
with a program quality assessment that can be used 
by the schools in their prpgrant 'improv^ent 
Efforts. Second, they provide; state-level informa- 
tion on cqgipliance with the legal requirements of 
each furidinlksource and information on the overall 
(juality of the implementation of school plans and 
programs. • 

In program year 1975-76 the Department of 
Education conducted monitor and reView (MAR) 
visitations to schools that were receiving ECE, 
ESEA Titlf I, and/or EDY funds. At the\ime that 
this report was compiled, 95il school MARVecords 
were on ^ile. ; * J 

MAR teams of at least two, persons visited all 
schools during the ^)eriod from Novemb^ l.^ J[975, 
through May 31, 1976. The 'teams spent two days 
in schools ,/^ith" 14 or more participating class- 
rooms. Smaller schools were reviewed in one day. 



The visitijig team^'con^sted of either a Department 
" of Edjticktion- employee or other e^cperienced indi- 
viduaC who acted as the lead person^ and a backup 
p^on,' who' was, in most instances, either' an 
employee of the Department,, a district -.staffs 
member, or a staff member of an office of the 
county superintendent of schools- some cases 
instructllrs from-' various- California/ coilegeS^%id 
' universities acted as backup persons or observers. 
The MAR teams used two forms for each school 
review: the "program Quality Review Instrument" ' 
T (PQRI), and the "School Level Program Compli- 
' ance Review Inslrurnent" (compliance document). 
A third form was used to review. 'district office 
compliance with the regulati?)ns governing the 
various programs. This form, the "District Level 
\ I^rogram Compliance^ Review Instryment,", was 
used by bothahe elementary and secondary staffs 
in their district audits. . ' ' 

Part ry :0*f this report includes a description of 
the MAR "Program Quality Review Instrument" 
. (PQRI), the. statistics from the various sections of 
the PQRI, correlational analyses^, an^l inter-rater 
- reliability data. A copy of the PQRI is included in 
Appendix C. 

Special -Surveys f 

The Department conducted special surveys to 
examine the nature and extent of institiitional 
change at :a level beyond that indicated by the 
aggregate^ statewide school-let^ planning and 
monitor ind review data.' ' ^ 

Thd topic areas for the special surveys, which are 
listed in Table IV-1, werejbased, in part, on 
" program components requfirea by ECE, ESEA Title^ 
I, and EDY'. In. additiojir to the component refer- 
ents, however, theV'surveys also attempted to 
address institutional change questions and issues 
raised byy the program'' and program evaluation 
staffs as well as questions arising from a search of 
the literature .on the nature of change in educa-* 
tional institutions. ^ 

The Department conducted' H special surveys 
during 1975-76. Findings from six^f the special 
surveys were sufficiently complete to include in 
jthis report. .Summaries of those findings can be 
found in Part V. Technical reports on the findings 
of the remaining five surveys will be available, at a 
later date. 

For each special survey a scientific procedure 
was used to ensure that the sample was representa- 
tive of ECE, ESEA Title I, and EDY schools. The 
" two exceptions to this 'sampling procedure were 
that: (1) the secondary schools survey included all 



secondary schools with ESEA Title I or EDY 
funding; and (2)'the multicultural education survey 
was based on a sample : of schools that were 
•selectee^ on the basis of -the racial:ethnic distribu- 
tion of students, and the rural-urban characterisijics 
of the community. ^ ' 

; Questionnaires were ■ uised for eight of the sur- 
veys, and field observation techniques were used 
••for thre^. The instrumentation or procedures that 



\ 



were' used and the sample size for each survey are 
sho.wn in Table IV-1 . 

the percent of return for the survey question- 
naires varied from a low of 56 percent to a high of 
92 percent, with a median return rate of 71 
percent. Information about 'ihe distrib*ut ion and 
return of the ^estionnaires 'is surhmarized in 
Appendix D. . 
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<^ TABLE jy-l- 
Summary of Instrumentation and Procedures in the Special . Surveys 



Survey- 



Questionnaires 

Achievement reporting 

Adults in the classroom 



Decisioormaking styles 



Individualization of instruction 




Parent involvement 



School' advisory committees 



Secondary schools 



Staff develojJment 



Field observation^ ' 
Day in the life of a typical student 



Multicultural education 



Plartfiing 



Number of schools 
- in (he sample 



Instrumentation or procedure 



143 ♦ 

69 

249 
74 



220 



1^5 



181 



II 



23 



15 



Achievement reporting survey 

\ •* ' 
Classroom teacher survey 
Paraprofessional survey 

Prinnjipal opimon survey - ^ 
Teacher opinion ^sufVey 
Parent opinion survey 

Language program survey 
Reading/prograp survey 
Mathematics program survey 

Staff opiiiion survey 

Parent ofiinibn survey i 



School advisory committee chairperson 
survey 

Schooladvisory committed membpr 
survey " * 

« < . 

Teacher survey ^ 
Administrator survey 



Staff development survey 



Observations by Office of ^r^^m Evalua- 
tion and Research staff meffroer 

Observations by Bureau of Irrtergroup 
Relations professional staff members^ 

Observations by Office of Program Ev'alua- 
tion and Research staff member 



Assessment of Student Achiwement 

The .principal questionvin assessing the effects of 
school programs on stuoent^chievement is: Hpw 
well did the students p/rform compared to how 
they would have perfonned had they ;iot partlci-^ 
piled in school programs supported by ECE, pSEA 
Title I/and EDY? Unfortunately, this question 
canrto't be answered directly because districts, 
schools^ and students are selected for participation. 
. in ECE, ESEA Title i; and EDY in accordance with 
prescribed criteria for eligibility. The effect of 
these selection procedures is that pfogram partici- 
pants differ from non^^rticipants in terms of not 
' only, the criteria for eligibility that'they, meet but 
. also jn 'term^ of a mjqiad-of other variables related 
to school background and student population. 
Conseauently, evaluators have developed tech- 
nique that provide indirect evidence from which 
inferences can be made about program effects. In 
this evaluation repoft inferences hgjKe^been made 
on th"9 basi? of two types of comparisons: those 
b6tweei| program^ participants and , publishers* 
^ilation^ norm groups; and those among ECE 
■ schools Tand between ECE schools and ndn-ECE 
^hools# on the basis ; of California Assessment 
Program (CAP) data. 

' .< y :'\ ' ' . , ■ 

Standardized Achievement Test Data 

The data that are presented in the areas of 
Student achievement are from objective, standard- 
ized, norm-referenced achievement tests, the 
Tesults of which were reported to the^ Department 
through the year-end "Product Evaluation 
Report.'* These tests aife relatively insensitive to 
specific . instructional programs* that is, they 
measure general objectives. quite well but measure 
specific ^objectives poorly ;br only by inference^ The 
instructional activities in any given program Tre- . 
quently stressed specific .objective^^ and, hence, 
their effectiveness could not be measured 
adequately with standardized, norm-referenced 
tests. In such cases the use of standardized, 
no\m-referpnced tests tended.to result in underesti- 
maros of thfe actual instructional gains made by the 
students toward the specific program objective. 
The use^ schools of * variety of instruments to 
tfest-^®rticip3hts Compounded the problem. The 
Department of Education was constrained, hpw-* 
eve/ tp use standardized, rionn-referenced tests, 
siJlce such tests made comparisms among groups 
•possibly. The problem of mfeasujk and comparing 
the progress, of schools— eact^g^B its own unique 
set of objectiv:es-^>Yas alle\^^^only partly by 
allowing schools to choose; jBarticular commer- 



cially developed standardized achievement test for 
use in the evaluation. • V 

In some respects the use of instrunients specifi- 
cally ' designed to measure the acquisition of spe- 
cific skills would be a better practice. To the 
extent that programs are unique and meet the 
unique needs of a. variety of students, -however, the 
results would-be expressed as an unmanageable 
number of unrelated specific scores. Tp aggregate 
siich scores to represent the performance of groups 
of- students would be impossible. Within these 
limitations standardized, norm-referenced tests are 
gSnerally the best available aggregable indicators of 
students* academic progress. ' ^ 

Schools were . required to administer standard- 
ized, norm-referenced achievement tests in reading 
and mathematics on a pretiest s^nd post-test basis.^ 
The achievement tes^s that were used, reported by 
frequency of use, art ^ted in Appendix E, 
Typically, pretesting was conducted, in October, 
1975; and post-testing wa§ conducted in May, 
1976, The frequency distribution of elapsed tin^e 
between pretesting and post-testing 'for schools is 
shqwn in Appendix F. * , 

. <-Publisher*s national norms for/achievement test 
rrscores represent the achievement level of the 
average student in the'^natidn. A comparisons of 
participant scores with publishcjrs' national norms 
is usefal in that it indicates how* participants are 
scoring relative to a nationalsjjnple of students at 
the same grade level. 

While test scores have ofteqjbeen expressed in 
grade equivalents, many techniqal. shorlcortiings. 
exist in the use of this particular type of derived, 
score. A technical discussion of the'shortcorhings 
of. grade equivalent scores can be found in Horst, 
Tallmadge, and Wood. ^ Given these shortcomings, 
the Department has reported student achievement 
usitig standard scores based on a national ' mean 
score of 50 and a standard deviation of 10.*These 
stand^d scores were computed from mean raw 
scores when in-level testing was conducted and 
from mean scale scores when out-of-level testing 
was used. The standard scores were corpputed as 
follows: • 

where T = standard score 

X'= school mean score 
X= publis/ier's mean score 
Sb = publisher's standard deviation 



^D. Horst, G. K. Tallmadge, and C.^^ood, Measuring Achieve- 
ment Gains in Educational Projects (RMC Report UR-243). Los 
Alt6s, Calif.: RMC Corporation, October, 1974, pp. 9 and 10. 



• Conversion of the data- to standard scores 
facilitated inteppretation of the findings in relation 
to national norms./ Assume, for example, that 
- students had an avefrage standard score of- 48 . on 
the pretest. If the students' average post-test score 
was also 48; they/ would have maintained their 
same position relative to the national norm group. 
In other words, the'stiidents would have made the ^ 
same gain that the norm group made. To • the 
extent that the post-test score wals greater than the 
pretest score, the. students could [be considered to 
have gained more than the norm group, • 

IiV the computation of achievenient^ains, scores ' 
were used for only those students for whom both 
pretest and post-test scores were* available. Te^t 
inf9ftnation that was either incomplete or based on 
procedural irregularities was not' usedin developing 
statewide averages. Examples pf irrgomplete data 
apd irregular procedures included instances^ in ' 
which (1) either pretest or post-test information' 
\vas omit't^d;' (2) test results were cont^iJE^ for 
several grade levels: (3) test scor^^ere Hot 
reported in terms of either raw scores '^'br scale, 
scores; (4) tests without national norms were us^d; 
(5) the elapied; time between the pretest; and 
post-test was^ss thah five months; and (6):np' test 
c^sults.. were reported., A substantial quantity of 
usable data fi:orn grade one was lost due to the 
unavailability of fall norms. , 

The Dep/rtment recognized that gain scores on 
standardised achievement tests piay be influenced 



by bpth th*{elative time of protesting afrd by the 
amquht of elapsed time* between pretesting and 
post-testing. The Department controlled as much ' 
as possible for this effect by eliminating scores\ 
with inappropriate intervals between the pretest\ 
and post-tiest. Test dati are reported, hf time of 1 
testing, in Appendix G. 1 

California Assessment Program Data 

/ Comparisons were also conducted on the basis 
• of data provided by the California Assessment 
Program (CAp). Analyses, 'of trends in reading 
; scores, and an examination ofi the relationship { 
between reading achievement and socioeconomic ) 
and demographic ^vari^iblei were conducted forf 
ECE schools ancj for a matched^ groUp of non-ECE 
schools. This longitudinal study of reading achieve- 
^ inent performance df E^E schools was provided by 
. data obtained by . multiple regression analyses of all 
schools in CalifornJa. California -Assessment Pro- 
gfam d^ata for ^ades two and thre6 for the years 
'~ X972-73. tKrough r975-76' were used. Tlie school 
served as. the unit of analysis; and the regressio/i 
•^variables included grade one Entry Level Test 
scores from the California Assessment Program, 
socioeconomic index, percent of bilingual students, 
and student mobijj^y rate. As a result of the 
analyses, it was possible to observe changes in 
reading test scores among ECE* schools relative to - 
changes in student populations and length of ' 
^ program participation. -f / 



/ 




VV Findings 



' . ' ^ This part ^ of the evaluafcn report contains • 
•* findings -regarding (1) p^icipants and exppndi- 
/ tures in.ECE, ESEA ffitle I, and EDY; (2) 
institutional change; and (3) student achievement. 

Enumeration Data on ParticipaYits 
Enumeration data are provided on student par-. 
^ ticipants, volunteer participants, and expenditures. 



for ECE. ESEA Title I. and EDY. 



- Student Partic.ipants ■ ^ 

X total of 939,189 students in Jdndergarten 
through grade twelve participated in school pro- 
ems supported by ECE, ESEA Titled, and EDY 
in 1975-76.. The number of student parti^pants,* 
by grade leyel, is shown in Figure V-1. 

Of the \total participants approximately 68 
percent were enrolled in kindergai'tQn; throu^ 
* grade three* 23 percent were enrolled in grades 
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Total number of students served: 939.389 



Fig. V.I Number of student p^cipants in ECE, ESEA Title I, and EDY, by grade level, 1975-76 
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tour through six; and about 9 perceixt were 
enVolled in grades seven through twelve. Th6 
nujnber of students served during 1975-76, by^ 
funding source and giade level, is included in 
Appendix H. 

Of the stud.ents served in ^all programs, more 
received services in reading and mathematics than 
in any other instructional coipponent. More than 
883,500 students were served in reading compo-j 
nents, and more than 849,500 were served iij 
mathematics corhponents. The numbers of particir 
pants involved in a majority * of the activities in 
other components are presented in Appendix II 
Participants who were involved in more than one 
component Were counted* for eacli component in 
vhich they participated (duplicated count): . ' 

ECE partici^nts. School-level, reports indicated 
that 426,747 students participated in (ECE-fonded- 
programs diirinQ 1^75-76: 113,009 iW kindergar- 
ten; j 10,352 in grade on^ijj92Vl 88jjj/grade two; 
and 101,198 in grade three. During the years 
1973-74 through 1975-76, the percent of kinder- 
garten through grade three students statewide who 
participated in ECE increased steadily. The percent 
of kindergarten through grade'three students state-] 
wide who participated in'EGB, by year, is shown in] 
Table V-1. 

ES^A Title I participants. During the 1975-76^ 

J:hool »year, 529,845 students from pceschool' 
irough grade twelve participated in ESEA Title I 
rograms.* Of the total number of students served,' 



TABLE v-i 

Percent of Students Statewide Participating in ECE 
Programs, 1973-74 Through 1975 76 



'^Oracle level 



fCindergarten 

One 

Two 

Three 



Total enrollment 



Percent of ECl: enrollment, 
by school year 



1973:74 1974-75 1975-76 



17.2 
16.6 
1.1.4 
9.9 



13.8 



25.3 T"' 

/ 

25.S' 
/ 

23.A 
2^. 



2^ 



34.4 
33.9 
33.6 
33.6- 



34.0 



.. ' in the Consolidated 'evaluation sum 
1974-75, the number of Title I particip 
represented 9 count of all students 4n s 
Title I funds. In this report the summ 
nuipber of studei>ts who participated in' 



m^ry/teport for fiscal year 
ported (591,561) 
Is th\lreceived ESEA 
count reltects the actual 
1 programs. 
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508,672, or 96 percent, were enrolled' in public 
schools.* Detailerii eifrollment data are presented in 
appendixes J and K. Gjohsistent with state policy, 
the greatest concentration of participants was in 
the primary grades, where 53.4/percent of the 
participants *were served in- kindergarten --through 
^ade three and 33.8 perceiA vv^rfe^ in grades 
four through six. Of . all stu^ntjparticipants 12.3 
percent were served in gradesi^n through^tweive." 
Table V-2 shows the distr^brafo^^ grade Igvel, of 
students in Califoraia-who,&^|ed ESEA'45tlM 
services from 1967-^8 trirbul^hrip^ 

EDY participants. During me 1975-76 si^^ 
year, 400,754 ^tudents, from foreschool thfegh 
grade twelve, participated in pfograms fun<^^rby 
EDY or by . EyDY in combination with dther 
funding sources.^ Of all students^ served," 51 .7 
/percent were enrolled in kindergarten through 
grade, three; 34>J^percent were enrolled in grades 
four through' six; and the remaining 134 percent 
were enrolled in grades seven through twelve. Tlie 
number of EDY participants, by grade level', is 
sJRjwn in Appendix L. . ' 

Volunteer Participants 

Nearly 351,000t hours per week of program 
assistance were donated by 81 ,505 adult volunteers 
during 1975-76. The average number of hours of 
assistance pef -wejek per volunteer was 4. 3, Tlie 
.majority of volunteers, 61,944, or 76 percent-5 
participated in ECE-fundeid programs or in pro- 
grams that were funded by ECE in cbmbinatipn 
with ESEA Title T and/or EDY. A total of 19,561, 
or 24 percent, participated in other multifunded 
programs. ' 

Expenditures 

In 19^5-76 a <:ombined^total of $282,1 84,320 in 
ECE, ESEA Title I, and EDY funds was allocated 
, to local educational agencies. The allocations, 
expenditures, and carry-over funds for each of the 
three major funding sources under the consolidated 
application process were to be reportec^n a special 
expenditure report at the end of the 1975-76 
program year. Although the audit of the re|iprts 
filed for each funding source was not complete at 
the time this report was written, it was possible to 
select for evaluation a random sample of reports 



In the consolidated evaluation summary rcpo^ for fiscal year 
1974-75, the number of EDY participants reported (436,009) 
represented a count of all students in schools that received EDY 
funds. In this report the summary count reflects the actual number 
of students who participated in EDY programs. 



fromvECE, ESEA Title I, and EDY school?. Each 
>4istrict reported a summary of the total amounts 
expended for all of its schools that received ECE/ 
ESEA Title I, and/or EDY funds. Figures V-2 
throu^ V-7 show the percents of funds expended 
in various budget categories and for various cate- 
gories of personnel in the districts that were 
sampled. However, since these figures were based 
on ai sample of th^eports that were returned, the 
reader should- u^^^ution in interpreting them.^ 
All school reports are being reviewed as fihal 
budget figures are subniitted, and these percents 
.will be computed for all participating schools. " 

.iSindlr a varfety of funding sources often "inter- 
act" within a school, expenditure patterns in such 
schools may reflect deqisions about only which 
"souri:e" \to u?e-. to provide Specific parts . of a 
^ultifunaed, supplementary school progrim. 
Furthermbre, the furfds in all- cases miist supple- 
I ment, not Supplant, base program funding: 

ECE eJtpenditures. ECE provided $61,894,358 
to 1,7Q9 eleiAentary schools during 1975-76. Of^ 
the total, $44512,835 was^ provided to 1,336 
, continuijig ECE schools, and $17,581,523 was 
provided for new programs at 457 expahsion 
school -^ites. ..-^ 

As is^hown"in:*&^g:ure V-2, of the ECE funds 
expended, by schoolp, 45 percent was spent on 



salaries for classified staff (e.g.,* teacher aides)' 'to 
lower the student-to-adult ratio in the classroom. 
By contrast, certificated ^.g., teachers and other 
professional staff) salarie^mployee benefits, and 
books and materials each represented a smaller 
proportion of ECE expenditures. / ^ " 

The relative percents of additional school per- 
sonnel, by category, employed with ECE funds are 
presented in Figure V-3. 

ESEA Tifi^ i expenditures. In 1975-76, as » 
shown in Tabl^sy-3,'more than $156 million was 
allocated to' the^tate by the fedieral government. 
forMisbursenient tovstate and local agencies. Of the 
totaI^apprOximatelM^130 niillion was' distributed 
to k^8 public spmools throughout California as 
grants to locareducauqnal agiencies. , 

ESEA Title I expenflitures, by budget category,' 
are shown in Figurej^V-4. A'c6mf)arison of ECE 
expenditures and ^S^A Title I expenditures 
showed , that a substantially higher percent of 
ESEA Titte I funds was used for teacher^ and 
supervisory salaries and that a lowei* percent of 
ESEA ^itle J funds was used, for the salaries of 
classified personnel. 

The relative pq-cents of additional school per- 
sonnel, by category, Employed with ESEA Title I 
funds are presented (^in Figure y-5. Aides repre- • 
sented the largest single category of personnel 
employ^ in ESEA Title I programs. 



^The sample deluded unaudited reports of 31 distiict'and 12 
cooperative summaries of ECE expenditures, 26 district summaries 
of ESEA Title I expenditures, and 31 disttict and' 7 cooperative 
summaries of EDY expenditures in 1975-76. 



EDY expenditures. During 1975-76 a total of 
$90,389,376 in EDY funds was" distribute* to 
1,291 public schools in California. 



TABLE v-2 



l^ercent of ^tudents Receiving ESEA Title I Services in California, by Grade L^vel 
Groups, 1967-68 Through 1975-76 



Percent ^ti^ta 



HSBA Title \ enrolKjient, by school year 



Grade level 


|9(,7-6'« ' 


1<)68.69 


1969-70 


1970-71 


1971 -72^ 


1972-73 


1973-74 


1974-75 


1975-76 


Kkidcrgartcn 
througli gradp 
three 


40.4 


4L8 


50.4 


. 52.1 ^ 


51.9 , 


54,0. 


56.5 


• 54.3 


' 

53,4 - 


Grades four 
througli $ix 


: 22.8 


^1.7 


33.0 


33.9 


347 


35.3 V. 


' 30.3 


34.0 


33.8 


Grades seven 
through nine 


19^ 


20.7 


8.9 


9.f . 


• 3.2^ ' 


* 6.6 


8.4 


8.3 


9.4 


Grades ten 
through twelve 


; 12.4^ 


10.9 


4.0 


3.6 \ 


. 33 , ■ 


2.7 


3 J .. 




2.9^ 



NPTE: l-igorcs for participants, in preschool and ungradied programs are not included in this table; Jhcrefore, the values in the respective 
columns do not total 100 pertent. 21 ' 



Expenditures among sampled EDY programs, as 
, shown in Figure V^, indicated that-unlike for 
ECE and ESEA Title J~the ntajority of program 
funds were expended on Certificated staff rather, 
than on classified staff. 

A comparison of budget categories of EDY 
funds qnd percent of personnel funded by EDY, 
thown in Figure V-7, indicated that, although aides 
and other support staff represented 70 percent of 
the additional ^ persbnnel employed . wdth ^EDY 
funds, only 17 percent of the funds- allocated to 
schools werejused fpr payment of their salaries. 




1^ ■ . , 

Institu tional Change 

As was noted eariier, ECE 'provides" a process 
through which schools take a compfehejrsive 
approach to their program planning, implementa- 
tion, and evaluation. The changes in these program 
aspects or processes collectively define the institu- 
tional cha^lge that occurs M a school. The impact 
of institutional change was generally evaluated in 
terms of iiatings^ .of school-level plans aiid the 
ratings derived from- the monitor and review 
(MAR) process. In addition, various special surveys 
were conducted to review specific aspects 6f spfiool 
^ programs. ^ 

'3 : ' 




Fig. V-3. Percent of pei^onnet funded by ECE projects, 
1975-76 



TABLE V.3 

tduaitioiial Agencies Receiving ESEA Title I Project (iraiUs in Cajifornia, 1975-76 



Agency- • 

m — ..^ / '.vv^ ,: ■ — 


Grant award amount 


Percent of total ' , 


Local cdiiCiilioiuI agencies. 


SI 30.039.420 


83.1 


Slate educational agencies 
Migrant education 


18,5O^M>70 


> 

1 1.8 


Neglected ;jiid dcliiK)iient 


2 AH') All 


\.h 


1 landicupped childrer) » 


1,013.010 


().<> 


.(aJiJoiin;) Slate Department of Ileal III 


1 .34(),5()S 


' . o.w- 


( alirornia Youth Aiitliority 


/r.44?i.o<s: 


0.0 


California State pepl>rlnient oi rorrfrctions > 


IH3.42I 


' 0.1 


State adnnmstration 


1 .52(>J66 


1.0 . 


T'otal 


$,156,555,748 


1 00.0 



Fig. Budget categ^^ories of ECE funds, by percent of 
; expenditpre, from a^canctom sample of unaudited 
reports of 31 district. an4 12 cooperative sum- 
maries, 1 975-76 ' ;> 



School-Level nanning ' ? 

Schools that received funds thro^igh the consoli- 
dated ppplication were required to coYnpkte a 
systematic planning process for each of the follow- 
ing program components: 



Language development 
Reading * 
Mathematics 
Multicultural education 
Staff development 
Parent participation' 
Parent education ^ ' . 
Health/auxiliary services 




Employee benefits- 13% 

Books, supplied, ^ 
and equipment replacetnent 5'-T 
Contracts, for 
personal seiVice.s- <\% 
Travel, maintenance, rent, 
and contracts- V^c 
Capital outlay \7o 
Indirect costs- < 1% 



A n^ajor in&titutional change finding cdncernijig 
school program planning was that all 3,220 sclm^ols 
that receivea'ECE, ESEA Title 1, or EDYbfu^fial- 
prepared and siflwnitted comprehensive' Drogr|im . 
plans for 1975-76. For the great majorityfof th|jse ^ 
schools, this annual planning process was imple-* 
mented through the state reform efforts. 

Of the 3,220 sl^hool plans that were submitted. 
1,899 were updates of existing plans/ including 
those from ECE schools from previous years; and 
1 ,32f^were from schools new to the consolidated 
application process or from existing ECE schools 
Wfnat .were reguired to submit rewritten program 
/plans. The Dep^artment conducted detailed quality 



Media specialists - 1% 
Administration 2% 
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Pupil Personnel 1^ 
Servic^ 3% 

Clerks and others 77r 



rtg. V4. Budget categories i>f . ESEA Title I funds, by 
percent of expenditure, from a random sample of 
unaudited reports of 26 district summaries, 
197^-76 
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Contracts for 
'personal services -2% 
Travel^ maintenance ,rent 
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-Capital outlay 1% 
^ Indirect costs- 1% 




Fig. V-5. Percent of personnel funded- by E^EA Title I 
projects, J975-76 
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Fig. V-6, Budget categories of EDY funds, by percent of 
expenditure, from a random sample of unaudited 
reports of 31 district and seven cooperative 
summaries, 1975-76 



Fig. V-7. Percent of personnel funded by EDY prbjectfl. 



1975-76 



23 



22 



ratings of plans of only the 1,321 schools that 
submitted new • or full/ 'rewritjen .'plans. The 
remaining plans were reviewed for compliance with 
applicable legal requirements. 

The quality of school plans naturally varied. The 
review of school plans enabled the Department to 
make sQfneJudgmenfs related to the clarity and 
consistency c^f the .plans, and the extent to which 
-solution procedures -would meet the^ needs 
described by the schooh^ * 

The instruqient that used -to fate plans' 
incorporatecl a 0-5 scale^ for each of ten items that 
were appliczj^ble to the eight fequirod components. 
Five **generar* items were also iricluaed, for a total 
of 85 it^s. . 

The component item averages varied from a low 
\ of 2.4 to a high of 3.5. Arnorrg the components the 
highest item averages (3.1 to 3.2) were for the 
language development, reading, mathematics, staff 
development, parent participation, and health/ 
auxiliary services components. Item "averages for 
' multicultural education and tjie optional instruc- 
tional components were 2.8 and 2.9, respectively. 
The one relatively low-rated component w^ 
bilingual education (2.5), the component for which 
schools described ttov/ instructional^ervices were 
to be offered for limited- and non-Chghsh-speaking 
students. \ 

Program Implementation 

In 1975-76 the Department used tvvo methods 
to examine the nature and quality of program 
implementation: the monitor and review process 
and a series pf special surveys. Findings from the 
special surveys are presented later in this part of 
the report. 



The . *Trogram Quality Review Instrument" 
(PQRI) was designed to facilitate assessment of the * 

^ qualitv^of school program implerpintation. this 
instrument was r'^designed for 1 975-76 and 
included 54. items related to a school's ECE-funded 
program. Of those 54 items 51 were also applied 
independently to non-JECE -kindergarten through 
grade three t)rogranis and/or upper grade*ESEA 
Title I and/br EDY programs. Eleven of the 54 

V ECE items dealt with, the implfementation of the 
r program in accordance, with the school'^ program 
plan (SepUon I of the FQRI); six dealt with 
progress towar^Lrestructiirinftiir revitalization (SeC- 
.a6n II of the PQRI); anU/^ dealt with the quality 
of instruction (Section III of the PQRI)^! 

At the time this report was written, program 
qyaJity review ratings for 951 schools were avail- 
able for analysis, (if the 951 schools 457 entered 
ECE in 1975-76, 311 entered ECE in either 
1973-74 or 1974-75, and 183 were receiving ESEA 
Title I and/or. EDY funding, but not ECE. funding. 
Table V-4 shows item averages from /the- 951 
schools. > 

The item averages for ECE grades ragged from 
2.9 to 4.2. The item averaged for nferf-ECE grades 
ranged from 2.1 to 3.9. Individual item averages 
are presented in Appendix M. 

The highest ratings were given in Section I of the 
PQRI, '^Implementation according to plan." No 
item average was below 3.6 in ECE grades, arid 

'none was below^3.3 in non- ECE grades. Implemen- 
tation of the reading and mathematics components 
in accordance with the plan received the highest 

- ratings in Section I of the PQRI. 

Average ratings for the six itepis in Secty^ II of 
the PQRI ranged from 3.4 to 4.l/lvith one 



TABLE 

I>escriptiye Statistics for the 1975-76 Monitor and Review t>ata for the 54 Ite;ns Comprising the Total K-3 
Scores and the 51 Items for ESEA Title I and EDY Programs in Grades Four Thrpugh Eight 
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exception. The average for the item relanng'to 
progress toward parent participation and (parent 
education in the non-ECE grades was 2.9. The 
average for ECE grades on this same item was 3.6, 
which indicated that the emphasis of ECE oif 
parent involvement was effective in bringing 
parents into the school prograih. 

Section III of tiii PQRI, "Quality of instruc- 
tion,** contained the folio wiitg si\subsections: 

1 . ProgramNplanning, implementation, and Evalu- 

ation 

2. InstructionVl program 
• 3. Health/auxyiary services * 

4. Parent pyiicipation/community involvement 

5. Parent education 

6. Staff development 

' >^ . % " , 

The item averages witjjpn the subsections varied; 

and, significantly, no siiigle |^l?^66tiok showed 
consistently higher scores tR^,. the^ others. The 
averages for items -concerning TeadingVor mathe- 
matics wertf consistently high (3.5? to 3.8), whereas 
the average for items concerning language develops 
ment.was a relatively low 3.1. The average scores 
for self-concept and health items were, high (3.8 to 
4.1), while the lowest average scores (2.1 to 3.0) 
were those for items relating to parent involvement 
in non-ECE grades. The only EC5-grade item 
average below 3.0 was that for regulaf involvement 
of parents in program evaluation, for which the 
average score was 2.9. 

Correlations of monitor and reviey^ (MAR) 
scores with school' plan scores and California 
Assessment Program (CAP) grade three reading 
achievement scores. The HBlationships between 
monitor and review (MAR) scores and school plan 
scores and between MAR scores and California 
Assessment Program (CAP) grade three reading 
achievement scores were investigated by means of a 
correlation analysis. Table V-5 presents the results 
of that analysis. 

The low statistical relationship that was found 
among the various assessment procedures was not 
surprising. Each procedure was designed to 
examine distinct processes: program planning, pro- 
gram implementation, and student achievement. 
Each review served to provide a description of the 
program at a given moment in the total process. 
The plan rating reflected the quality of the schooKs 
initial program design, and the monitor and review 
(MAR) scores reflected the quality of the program 
at a given -time during the implementation of the 
instructional program. 



TABLE v s 

Cofrelationf of State MAR Ratings 
witK Other Ratings for ECE, 1975-76 



Type of'ECE sctiool 



Continuing ECE schools: 
ECE Phase I and Phase ll 
(Entered ECE in 1973 74 
and 1974-75) 

New ECE $chck)ls: 
1 ECE Phase III-^ 
^(Entered ECE in ^975.76) 



Correlation between MAR 
^^ating and other ratings, . 
' by source of ratings* • 



School plan 




CAP third 
grade reading 
achievemenf* 



.12 



.08 



*The number of schoob ijjicluded in each analysts varied because of 
the unavaikability of complete school plan and MAR files, but in 
.i no case were f^wer thafi 144 schools included. 

Inter-team reliability of monitor and review^ 
ratings. The analysis of the monitor and revie^ 
(MAR) process in 1^*75-76 Included a study of the 
reliability of monitor and review team ratings. The 
reliability v^as assessed by ci^paring ^the ratings 
-that were developed independently at each of 1 5 
schools by each of two monitor and review teams. 
' The twovteams visitefi the schools and observed 
the schopls' programs at the same time, but they 
did not discuss their findings during the rating 
process. One team was officially 4^signated as the 
team whose scores would be entered in* the schools* 
files. The second team observed and participated in 
V all of the scheduled activities up to the last part of 
the visit. Each team met separately and completed 
the rating form independently. After the odmple- 
tion of the form, the official team conducted the 
exirt interview and presented its scores. The* 
observer team participated in the exit interview but* 
did not present its scores. A Spearman rank order 
correlation w^ used in the analysis of the 1 5 pairs 
of completed monitor and review documents."* The 
correlation coefficient obtained was .92, wiiQch 
indicated a very high inter-team reliability. ^ ' 



^Spearman's foot-rule method of gains is a rough method of 
obtaining an estimate of the relationship befween the rank orders of 
^e observations of two variables. The formula for determining the 

relationship is: R-1 « ^ which EG equals the sum of the 

positive difference in rank for each pair of scores and N equals the 
number of pairs. 



Special Surveys 

In addition to rating school plans and conduct- 
ing monitor and review visits to determine institu- 
tional change, the Department conducted, a 
number of surveys to examine selected dimensions 
of institutional change. The need for more cjctailed * 
information on the effects of ECE, ESEA Title I, 

^ and EDY on institutional processes at the district 
and scboQl Icvefe was pointed out in the Evaluation 
Report ofEQE. ESEA Title /, and EDY, 1974-75. 

^ The results of 'the surveys • reported on in that 
report fofiused largely pn specific requfred or 
recomme^ed components and provided a variety 
of information on' the naturd of these components. 

The following areas were addressed in the special 
surveys of 1975-76: 

• Role and function of^tbe school advisory 
committees in plgtteing . - ^ f 

• Opinion^ of parent^ and teachers about parent^ 
involvement in educational programs funded 

:by EG^ ESEA Title I, and EDY and about 
adultsWrving in the classrooms 

• Staff development component and staff inser- 
vice trainmf Tieeds 

• Field review of multicultural education pro- 
^ , gram efforts 

• Individualization of instructional practices in" ' 
language, reading, and mathematics . . . , 

• Qiaracteristics of reading programs in second- 
ary schools 

A summary of each survey for which the 
findings were sufficiently complete to include in 
this report follows. 

School advisory committees. An in-depth survey 
of school advisory committees was conducted to 
provide baseline information about the committees 
for use in future stujiy of institutional change in 
elementary scjiools. 

Questionnaires were mailed to a sample of 
school advisory comnjittees throughout the state 
for cQmpletion by their members at the last 
committee meeting of the schooPyear. Questioh- ' 
naires from 197 of the sampled schools were 
analyzed. ' ^ 

Answers to the questions were considered in 
light of the implications of school advisory com- 
mittee involvement in school affairs, in the making 
of school policies,^ and in the determination of how 
and what students learn.. 

The major'^uestipns addresied Were: ^ 

, 1. Do the school advisory committees exist, as 
required by law? ' 




2: Who participates on the committees? 
3^ How are the school aclvisory committees 
organized? 

4. How do'membecs perceive their role? 

5. What do the school advisory commit^ggj^o? 

All schools in the sample had a school advisory 
committee, 3nd 65 percent had had a committee 
for three or more years: 

The composition of the committees was fairly 
homogeneous across the state...Of the committees 
that were Sampled, 97 percent were comprised of a 
majority of parents.^|Hore thafi half of the com- 
mittees had more- thait^ percent parent member- 
ship. The second largest group of participants was 
school staff members, The remaining mem'bership* 
included representative^*^ the community and, 
occasionally, a district star f person or board'-of. 
education member, ^ 

Sixty-six percent of the members. of the#om-, 
mit;tees thi^ were sampled were parents, ^d in 
most cases their children attended the 
which the parent served on the committc 
90 percent of the .members were femali 
percent had had some college training; sl 

had completed, 12 or fewer years of schc 

than 90 percent of the members belonged to 
■ school organizations other than the school advisory 
'committee; 70 percent were active in another 
school organization. 

The size of committees varied across the sample 
from five to 38 -members, with an average member- 
ship of 13. School staff members volunteered or 
were appointed to participate .because of their 
involvement with state-funded' and federally 
funded programs. Parents generally volunteered 
after being invited to participate by school staff 
me^nbers or other parents.. Members generally 
served as long as they were able and willing,, 
although some schools had a one- or two-year 
limitatibn on the members' length of service. Only 
4 percent of the membership of the -committees 
was elected. 

The committees had a chairperson, who .was 
most often elected- by the other committee mem- 
bers. Chairpersons served a one-year term in that 
capacity. Approximately 56 perce.nt of those who 
served as ch^rpersons were parertts. Chairpersons ' 
prepared the agenda, usually together with the 
principal or some other staff member, and presided 
over the meetings. 

Thie degree of procedural formality of the 
committees varied, depending on the type of' 
school and the length of time that the committee 
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had been operating. Some cohimittees had written 
bylaws, which Svere. drawn up and approved by the 
members or, inf, some, instances, were written by 
another school-lev^el committee. The bylawt were 
of ten '^copies of fhe district advisqry coiiimV tee's 
bylaws. * Some ^hool advisory ' committees\had 
subcommittees mat worked in spejpific areais, 
as school ^lan, parent education, and information 
exchange. The subcommittees nae^p^parately and' 
reported back to the' school advisory comhtittee. „ 
Members • perceived the school advisory cbiii- 
mittee as a helping or |acilitatinjg body within the 
school, and, in generafj 'they perceived the princi- 
pals as wanting help from the committee. They 
perceived the committee's/rote as ort^ of providing 
help in implementing lirograms artd exchanging 
information between the school and parents. LeSs 
than 1 5 percent of ,the members perceived the 
committee as a policy-making body. Members 
perceived the con[imittee's responsibilities to 
include monitoring school programs throughout 
the year, providing parent education, and assisting 

.in preparation of the School plan. * 
• Most committees had a^regular meeting time. 
Ninety percent met^at l^ast .once each month; 40 
percent met more than once each month, espe- 
ci^y during busy times of the year, such as when 
the school plan and final evajuatioh were being, 
completed. Subcommittees usually jnet even hiore 
often than the committees met, depending upon 

'the specific activity (e.g., a multicultural fair, aide • 
policy review, and recruitment of parent volunteers). 

. The majority of committee, ^neeting time, was 
speat discussing those areas addre^ssed in the 
Etep^rtment of Edtfca'tion guidelines for* school 
advisory' cominittees. The largest proportion . of v 
time was sperrt discussing the program con\ponents 
included in the school plan-reading, multicultural 
education, and the like. The plan in general, budget 
revisions, evaluation,#end parent activities were the 
next most frequently" discussed* items. S|aff issues, 
such as training, grievances,^or aidey policies, were • 
not discussed-frequently. * \ ' ^ 

Members perceived their influence a$ ^eatest in 

: areas relating directly to planning, implementing, 
and. evaluating programs. When the committee did- 
handle parent grievances arid issues con^grning the 
community, members felt that their opinions aiid 
suggestioils didf have^-some influence on school 
policy. Similarly, the sdhool advisory Com- 

mittee conIJdere4,r staifiE:.vtTai^ and aide policy, 
members p/ferpeived their viewpoints as influencing 
decisions. . v 
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Farent involvement. District-level parent involve- 
ment in* program planning,' implemeiftation,. and 
evaluatiprt^has existed by state mandate for. the 
past ten yeare; school-level p'arent participation in a . 
variety 'of roles and activities has been strongly 
encouraged in ECE schools since the implementa- 
/tion of EC^. The main purposes of this . survey 
v^re to derive a description of parent involvement 
^ an4 to*deterjnine the importance attributed to it 
by parents and school personnel. Ninety-one 
schools werp included in the sample; opiniofi 
survey responses were received from 74 principals,* 
430 teachers, and 655^parents. 

The major questions addressed were: 

" i : To. what extent are parent^ involved in 
program planning, implementation, , /.-apti 
evaluation? , ^ ^ i , 

2. What* degree • of' importance, do ^eachers,^ 
principals, and parents attach to parent ' 
involvement? " ^ 

3. To whatextent are parents satisfied with theif 
, school involverfieht? 

Of the parents who responded to the survey, 45 
percent were involved-in classfodrn programs, 42 
percent were involved in planning, and 37 percent 
were involved in evaluation. Approximately 60 
percent of responding parents were or had been 
parent volunteers; about 17 percent had worked as 
paid teacher aides or tutors. Those parents who 
were directly;; .involved . with the school program 
cited tutoring of students as the activity in which 
they were most involved. : ' ^ 

For each of the three functions (i)rogram plan-, 
ning, implementation, anjft evaluation), parents 
reported a moderate degree of involvement. The 
level ol a parent's involvement did not bear, any 
relationshi^o his of her child's grade in school, 
.the type^o^ ' program (funding source), or the 
school population's socioeconomic status. 

Parents, teachers,, and principals perceived dif- 
ferently the- importance of parent involvement in 
planning and evaluation,, with teachers attaching 
less importance to parent ihvolverneht in these two 
areas than the other two groUps^'Mid. All grouptf 
» rated parent involvement in the classroom as above 
average in importance. The reported actual level* of 
involvement and the level of desired involvement 
^ related positively to the importance of itivolveirietfit 
as perceived by parents. ' . \ \ 

In general, parents indicated satisfaction with 
the available resources and instructional materials, 
with the performance of their children, and with 
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their role^ parents in the school proTgram.^Tliey 
, expresseffl the belief that parent involvement had a 
. beneficial effect on theij; child's attitude toward 
school. They approved of cliildren getting help 
from 'parents in the classroohi and felt very 
welcome in the classroom. Tlie general satisfaction 
with the effects of parent involvement in the 
classroom was shared by teachers and principals, 
Th^ levels of satisfaction with?, communication 

* from the school, and with thq sch oof generally, 
varied with the level of each responding parent's 
level of involvement. 

Staff development. Each school was required to" 
provide "Special training for personnel serving par- 
ticipating students. The main purpose of » this 
survey was to derive a description of the staff 

♦ development 'component in a sample of 181 
elementary schools. The principal or the principal's 
designee was requested to respond to the survey. 

The major questions addressed were: 

.1. What ' types , of^ personnel .participate in jhe 
'staff developtnent component? 

2. What is the reported effectiveness of training 
in the staff development component? 

3. What do schools recorrwnend for improving 
the abilities, of teachers* specialists, ^^aides, 
administrators, and volunteers to determine 
trends in the content of staff development , 
programs for J 976-77? 

4. What are the reported strengths and weakr 
nesses of --the evaluation instruments and 
methods that schools use to evaluate staff 
development objectives and activities? 

. Of the participants 41 jjercent Vere volunteers, 
20 percent were aides,, and 10 percent were' 
advisofy^'^fommittee members. Twentywnine percent 
were certificated personnel. Seventy-ohe percent of 
the participants served students in kindergarten 

• through grade three. Respondents reported an 
estimated expenditure for staff development of 
$18 to $14,250, with an average of $2,490 per 
school, or 3.6 percent of the* total ECE, ESEA 
Title I, atid EDY funds. 

. The major objectives reported for staff develop- 
, merit wej-^ the improvement of skills related to 
specific areas of . the curriculum, such as reading 
and mathematics (29 percent), and improvement 
of skills in the use of diagnostic/prescriptive 
techniques (22.7 percent). Seventy-one percent of 
the respondents reported that the major objective 
for staff development was attained or exceeded. 
Workshops (54 percent) y^re the type of training 
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program most frequently used to attain the m^jor 
objective. ^ 

The two majoi- recommendations for staff devel- 
opment for instructional personnel in 1976-77 
involved activities that would^ result in (1) addi- 
tional instructional skills in reading, ^mathematics, 
oral language development, and multicultural edu- 
cation; and (2) additional skills, related to studfnt 
motivation and attitudes'. The major recommeiula- 
tions QDr principals and other management pfer- 

'sonnel involved activities that wduld provide for 
training in school progran> management and staff 
communicatign techniques.' ' ^ , v • 
The most frequejit- recommendations for 

-improving the method of staff development were 
for visitations to otli^r schools within and outside 
the school district, more teacher and aide involve- 
ment in planning staff development activities, and 
a modified teaching day or release time for staff 
development. 

Multicultural education, Tlie multicultural edu- 
cation-purvey represented an attempt to. determine 
(1) the content *and methods of multicultuL. 
education, in' EGE, ESEA Title I, and EDY']^ , 
grams-^^f^Tthe ^lemgntary level; and (2) the various 
conceptions of the meaning ofthe term "multicul- 
tural education." A 15-page qr ^istiqnnaire was used 
to assess multicultural programs in 23 elementary 
schools. 

The major questibns addressed were: 

f 

1 . What sy-e some of the approaches to multicul- 
tural instruction being practiced in ECE, 
ESE\Title I, and EDY school programs? 

2. What attention is being given to multicultural 
staff development? 

3. What is the nature of parent and community 
'involvement, in | the multicultural education 
^ompon^t? ^ . 

A schoolwide multicultural education program 
was being conducted at 90 percent of the sampled 
schools, \ I;Ti ^those cases materials were readily 
availaj^ie to all staffs The organizational approaches 
and patterns that were -most often used- by the 
sampled schools for multicultural education 
included 'multitulfural units; articulation of multi-- 
cultural content with that in other subject areas; 
exchanges between schools; exchange teachers 
from other countries; special events and com- 
mentbrations; and- full-time multicultural resource 
teachers who visited each' classroom at least 30 
minutes per week and worked with the teacher in 
preparation and follow-up. 
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More than 90 perqent of the schools that were 
'sampled identified multici^ltural staff development 
as a need in their schqol plans. Thie other 10 
percent reported that their needs were met by a 
county inservice training 'prograj/h ^or believed that 
their basic staff development Vpeed was in the area 
of reading and other basic skills. 

. Ninety ..percent of the sampled schools imple- 
mented an . inservice training activity related to 
multicultural education during the past school 
year. Slightly more than half of thisy inservice 
training activity was offered at the school site. 
;More.tJhan half of. the staff of each school attended 
' the inservjce trailing sessions either at a school or a 
district site. lii .;more tjian . 50 percent . of the 
schools, one or 'more staff membets took part in 
college courses for multicultural inservice training 
purposes. Other sources of training were county 
programs, bilingual conferences and workshops, 
■^curriculum development activitieis, and exchange 
living/training in other countries. 

In two-thirds of the . schools, steps had been 
taken to identify the multicultural resources that' 
were available in the communities. Respondents 
atfported that these Resources were moderately well 
utilized. , 

Parents and others representing the ^ethnic 
•minority moups included in the- student popula- 
tions afto^comm unities repprted that they were 
involved to some ex;Jent in 'th«-i)lanning of multi- 
cultural programs. 

« With regard to the actual implementation of 
multicultural programs, approximately one-third of 
the ^minority group members who Vere surveyed 
said that they had been minimally inWved^ while 
another one-third stated that they had been very 
much invplved. The least participation by minor- 
ities tended to occur in those schools in which 
students vlrere predolRiiiiantly Anglo. 

Individualization of instruction. Individualiza- 
tion .dfiiist ruction Jo rneet the specific neeis and 
ii)tere^fs of each student js one of the m^jorjgoals 
of early childhood education as well as an impof- 
tanf means of accomplishing the goals of compen- 
.s^tory education programs. This survey of 
" 'mstructipnal practices involved the characteristics 
of classrooms, instruction, and instructional deci- 
sions from w^uch inferences could be made about 
the extent to which individualization of instruction 
was occurring: - \ 

' Survey questiorinaires, which addressed either 
rearding instruction or language instruction or 
matiiematitfs , instm^ sent to 166, 104, 

ancKSd schools, respectively. The principal at each 



sampled sch^l was asked to select randooily one 
tedcher to cAplete the survey. Completed reading 
sufvey que^bitrfaires were returned by\112 ' 
schools (hereafter called the r.eading sample); lan- 
guage survey questionnaires were returned by 121 
schools (hereafter called the language sample); an/, 
mathematics survey questionnaires were returned 
by 65 schools (hereafter called the math sample). 
Although each questionnaire was designated a^" 
being relevant to treading or language or rnath, the 



surveys were basically identical. Only the questions^^ * 

' \ ;ri^s#^. 
and the teaching of language Skills were different m - 



regarding the use of specffit texts and materiaTs* 



from. survey to survey. In the analysis Of data, the 
classrOjPm was considered the sampling unit. \ 
Although the reading sample -data, the language 
sample data, an'cl tht math sample data were 
analyzed separately, the findings from the three 
-samples were so simifer that they afe reported 
together. In instances in which the results from the 
three Samples did vary, tlje findings are repprted as 
contrasts or compari^ions. 

The major questions addressed were: 

1 . What types of information abPiit students are 
gathered, and wfiat assessment methods are 
used to gather information? 

2. Howl is assessment inforination used |n mak-,^ 
ing decisiorta . .^bout. instruction, and who- 
makes these decisitons? . ' . . ■ , , . * . 

,3. How prevalent is recordkeeping, and how-. 

helpful and worthwhile do teachers perceive it 

to be? • 
4. Do any impediments to implementation of 

individualized instructional programs exist? 

Two of the most important aspects of individ- 
ualization of instruction are the extent and nature 
of instructional decisions that teachers make 'for 
children and the kind of assessment information • 
that teachers use to^*make these decisions. For 
reading, language, arid mathematics/ leichers 
'■ reportjefd that they made riipre, than 9.0 ^ejrcent of 
- .the specific instructional decisions.* Such d^isions 
iricluded those in the areas of selecting specific 
taSics and instructional levels and grouping for 
iitstruction. ^ 

Teachers reported that they used a variety of 
assessment procedures. They used standardiasje^l, 
norm-referenced tests and criterion-referenced te^ts 
most often tb assess and gather. information" aboyt 
achievement/ skills, and readiness^ and they used 
teacher observation techniques to assess student.^ 
interests, attitifjes, and learning styles. Many^ 
,t||l-espondents also utilized information from sljHIs ' 
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Checklists, developmentj^l inventories, and student 
work. 

Fn addition to using a variety of assessment 
methods, teachers used a wide range of informa-; 
tion to make instructional decisions. For example, 
they used information about skills, readiness, and 
achievement to select tasks and instructional levels 
.and to group for instruction. In addition, they used 
information regarding student interests and learn- 

* ing styJcs .to selyct instructional media and to' 
^'deterrrtifle.aetivities and tasks for students 
. : Grouping for instructioti cjin^enhance the oppoi^ 

f tunities for indivi^^ifilize^ 'instrucfidn. . Teachers 
reported using spetific skHlsr. in readipg, language, 
and matli^matics as the most frequent bases, for' 
placing students in instructional groups; they used^ 
general readiness in reading or math and achieve- 
ment level in reading,, language, or math less 
frequently. 

In the survey, patterns of assignment of students 
to fixed or flexible groups in the classroom were 
examined. Fiked groups were defined as those,, 
whose membership did not change throughout the' 
school ue^. Flexible groups were defined as those 
whoseymemb'ership changed from time to time, 
thoui^ tot as often as weekly, 
v^ne assignment of students to one of three fixed 
g?qups, on the!' basis of their achievement as 
assessed once' a ye3r, seemejd to be giving way to 
more flexible grouping. In roughly 50 , percent of 
the classrooijis, both flexible and .fixed ^oups were \ 
utilized. Less than 17 percent of the respondeiys ■ 
reported .that they used only fixed groups, while 
more than 30 percent reported that they main- 
tained only flexible groups. Few differences' were 
noted among the reading, language, and math 
sample responses; 18 percent of the math sample 
reported no fixed or flexible group for ^math 
instruction, but the otheft* arrangements (fixed 
only, flexible only, and fixed and flexible) were 
, comparable across samples. 

The intent to WKich students oversaw or were 

• responsible for their own learning in varfous 
activities was another aspect of instnjctiohal deci- 
sion making that was examined.VMost activities 
appeared to be under the supei^isigri ,pf teachers 
and, to a^ lesser extent, classroom aid^s^Stude^ 
directed/themselves to'^iome. Extent in such 
activities as coloring, listening to tapes and records, 

■ and reading library books. Similarly, teachers 
repcmed giving students limited opportunities to 

; select among designfiited activities, except in such 
areas as coloring, {^laying instructional and other 
games; and using filmstrips, tapes, and records. 
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Tq Utilize, student assessment data and other 
information in ^ making instructional decisions, 
teacliers kept regord$/6f student progress. Whether 
thej^ . , viised |i; commercially developed, school- 
devdoped, or district-developed system or used an 
individual student or classroom proQle card, 
teachers: viewed their; recoriJWeeping as relativeily; . 
Ijelpful and worth wliile in ftjciJ\fiting diagno^ 
prescriptive teacliing. More than w percent of the 
; ■ respondents *in each sample rated their record- 
.l^f epin^.^s * Vor^^ it" or "very much worth it," 
;,^aild,ne.ai4y 60 percent rated their recordkeeping as 
'**'lielpfuj|" ;or "very helpful" in carrying outran 
; indi^duali^ed program. More than 60 percent 
tlie resportdents reported that indiviflual teachers . 
'Ij selected the pai^ticular recordkeeping system. to be. 
used and that the overall teaching staff made thai • 
^ decision about 35 percent of the time. Teachers ' 
reported assuming yirtijally all responsibility for 
keeping classrpbrn^cprds; only a small percentage 
of .respondents reported that anyone ^else, such as 
; aides, kept recordsi ' ^ 
^ . When given the'oppojtunity to describe factors 
that 'mSy have impeded the implementation of 
individualized programs, teachers reported , rela- 
tively few constraints. Of the respondents in- t^ie 
reading and math samples; less than 2Cf percent 
identified *or reported obstacles. The obstacles that 
teachers most frequently reported included lack Jf 
adequate personnel training (thecked: by< 37 per- 
. cent of all respondents) and laclc|bf appropriate 
materials; (^ited -by 40 percent of the respondents 
in the reading and math saofiples and by nearly 
•percent of those in the language/ sample). Overall, 
teachers apparently encountered rnore^ otetaples in 
individualization of la nguage instruction than they 
.. did in either reading or mathematics; 30 percent of \ 
the respondents in the language • sample cited 
inadequate numbers -of personnel*, and 40 percent * 
cited theix pwn philosophical objections, j 

' Secondary schools. The secondary schools sur- 
vey focused on jeading^service^' provided in ESEA ' 
Title I v^jid EDY programs. The person that the 
principal designated as being most responsible for ; 
the . reading program in 132 secondary schools > 
responded to a questionnaire concerning the 
schoors reading program. 

.y^^jThe purpose of the survey Nyas to identify 
features of the funded programs relative ;tb pro- 
gram components, student assessment, participa- 
' tion, successes, and problems. The major questions 
acMressed weje : . . - 
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1. What are the characteristics of reading pro- 
grams in secondary schools receiving compen- 
satory education funds? 

2. What functions does, the reading specialist 
perform? , " 

3.. To what-'extent ;:are l!(articipants involved in 
reading, proigfams? . 

4. What has been accomplished? 

5. What obstacles have interfered with the suc- 
cess of programs? 

ESEA Title I funds supported about ^0 percent 
of the programs in the schools that were sampled, 
and EDY and district funds supported most of the 
remaining programs, feeding specialists conducted 
i^O percent of the program?. About half of the 
relading programs were cctoductey ^s part of the 
^English program, and aboi^r^lf were conducted as 
a separate class. The functions that the reading 
specialists most commonly performed ' included 
teaching; remedial skills, working^' ivith other 
• teachere' .antl teachings developmental reading. 

The greatest' emphasis was generally given to 
"comprehensioi] and **surviv*ar* reading skills. 
Vocabulary development also received .strong 
attention. When asked to report the most common 
instructional practices, respondents listed studefit 
diagnosis^ fir^t.'' In, Tiearly every program student 
progress was assesised' by means of a combination 
of standardized tests, teacher^onstructed' tests, 
and teacher observations. ' ' 

On the ' average the specialist^, instructional 
aides, ahd teachers spent about 20 hours-each pfer 
we.ek involved in direct reading instruction. In 
'some cases re^p3TNentS:.i reported, that teachers 
spent up to otB^ho\n's in such Tnstructioir The^ 
average time that stu^nts spent in reading/pstruc- 



tion each we&k was apbroxinxately five ho 



irs, with 



as much as 25 hour^ reported in son e .cases. 
.Students were^volved to a^oderate degx[ee in the 
planning of classroom irtStrtfction./ v • 

Respondents reported success most freqti<ntly 
in individualized instruction (38 percent of 
respondents); in certain skill areas, such as phonics\ 
^and vocabulary (31 percent^of the respondents); 
and in iniproved self-image* of the student (20 
percent of the respondents). Eighty-nine percent of 
the respondents reported obstacles to success. 
Although the obstacles varied from program to 
program, those listed most frequently were lack of 
support or interest frorii the home (14 percent), 
poor student attendance (9 percent), and student 
fear of failure and related emotional problems (8 
percent), . - . " . 



Student Achievement Findings 

Tliis section of tlie report contains achie^ment 
data on students who participated in ECE, ESEA 
Title I, and EDY. The findings show how these*, 
students spored on (1) school-reported; commep 
cially developed $ta;i^ardi2ed>' testV; and (2) 
Califdmia Assessment Program (CAS) tests. \ 

The'' majqr* advantages of school-reported stan- 
dardized test scores are that (1) they are the only 
scdres available to assess the progress of students in 
schools participating in ESEA Title; I or- EDY but 
not participating in ECE; and (2) they are based on 
tests that were chosen by districts to address* 
unique district and schooJh^ohcerns. The important 
disadvantages of school-reported test scores ate 
that^l) major differences exist among the available, 
standardized tests in terms of their content anClj^n 4 
terms- of how they descritJe ^he riPogress of/ 
students from grade to ^ade^ ahd (j) man/ of 
theseij||j(^ have norms that-becaus^ of the estima- 
tion procedure/oised in the calculation of the 
normi-mffjt make U appear that students are 
progi^ssing at' a, ^tS* greater than that /if the 
nationals norm. Despite these technical disadvan- 
tages, school-rep<Jfted test" scores do provide useful^ 
inforpi^tion about the progress of students. 

With the Expansion of early childhood education^ 
4pd it;s focus on serving all students in kindergarten 
throligh grade three, attention has shifted in the 
consolidated evaluation report to* utilization of 
California Assessment Program (CAP) schoolwide 
achieverpent scores. A major advantage of these 
scores over -the school-reported scores is that they 
are based on uniforqi test% administered through- 
out 'the state. (the Entry Level Test for alidade 
one student^ and ..the Reading Test for allstydents. 
in grades two and three). Oh the other Rand, the 
disadvantages of the Cafifomia Assessment* Pro- 
gram tests are that, they are desimed to. yield only 
state-, jdistrict-,rj^nd school-level liata and do not 
provide "dSta ob subgrojips of students withirvV 
schools. - 

The section on student achievement findings fof 
ECE schools contains data from school-reported 
standardized achievement tests and data, from the 
California Assessment Program (CAP) tests. The 
section on student achievement findings for 
schools that received only ESEA Title I and/cfr 
EDY funds-contains only school-reported data. 



Early Qiildhood Education 

Pretest and post-test standard sc^feres for students 
participating in J^CE >vere used to (1) measure 
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reading and mathematics achievement gains for 
students in schools receiving only ECE funds and • 
for students in all schools with ECE funds (ECE 
. only, PCE/ESEA Title I, ECE/EDY, and ECE/.?> 
; ESEA Title I/EDY); and (2) deter^in« th^ ^ela- - ; 
tio>nship between length of participation in>EGE 
and differences inr stujdent performance in reading 
and niatheniatics. . , 

School-reported ;siti^ achieve-^ 
ment "test data. The graph for ECE-only schools in 
Figure V-8 showS average student reading achieve- 
ment scores for students in grades one, two, and 
three in schools receiving only ECE funds. The 
ECE-only graph indicates that the average pretest 
^ score for grade one students was 5^0.7 (standard 
score) and that the post-test averse* was ^J. 
:Thus, these stp^ents gaifVifcd 2^6 pointy niore than 
would otherwise Mye b'eeh^expecte^ year of ' 

instruction. While students in ECE-otily schools 
typically scored less than one point above th^ 
publishers* national horms^for their grade level on 
the pretest, they exceeded the publishers* norms 
by 2.9 to 3.8 points on the post-test. . . . t > 
The refsults ' suggest that within school years, 
^ , students in ECE-only^schools were cpiitinuing to ' 
pfogress^'in reading/at a rate greater than that 
reflected by the pu bli she rsV norms." A ' similar 
V ^ffnding was reported in t|ie Emlmtlpn Report of 
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ECE, ESeX Title K aftd EpY^ 19 74-75. On the 
basis of .1974-75 data, attempts were made to limit 
the possibility of biased norms being re&ppnsible;' 
for such significant gains. The statistical profcedures 
that were employed in 1975-76 reduced Ah^ gains 
only slightly and confirmed the finding 'pf signifi- 
cant gaitis. 

The other graph in Figure V-8 shows reading 
achievement scores for students in all BCE schools 
(ECE 'only, ECE/ESEA Title I, ECE/EDY,Vnd 
ECE/ESEA Title I/EDY). That graph shows that 
pretest achievement scores in grades one, two, and 
three were from 2.5 to 1.3 points below the 
national norms, but that post-test scores were from 
.0.3 to 1.8 points above the national norms.. These 
results indicate thdt. On the average, students in 
ECE schools Vere progressing in reading at 'a rate 
greater. ::than* that ; reflected -by the publishers- 
norms.' • ' * * 

to looking at the pretest and 
within each grade level, one can 
across grade levels for another 
By looking across grade levels in 



In addition 
post-test scofes 
look at scores 
interpretation.^ 



Although scores at different grade levels are obviously not from 
,the>>anie students* th( . scores aw frorn nearly the sapie grobp of 
ECE schools. Also, the scores for grades one, two/ aild three in \ 
Figure V-8 do not represent an equal number of schools, because 
many schools were granted waiven from standajrdized testing for; 
specific gr^de levels. ' 
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Schools Receiving Early Childhood 
Educatipn Fundt Only 



Schools Receiving Eariy Childhood Education 
/Funds Only or in Combination wit| ESEA 
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Fig. V^. ^jPretest and po^t-te^t^^tandard M^res^ r^adirf^l achfeveht&'t, b)^grade«level, fo% aU scliools participating in early 
- ' [•'chfldhood edticatioii funded programs, 1:9^ 



NOTE: School scores were weighted on the basis of tttriXumbcr of students tested. "Niinibfcr61f schools, by gra<ijVY^yjjprir 
of schools that reported usable achievement data for jgill^rade teveL > ^ . \ ' 'X^ * 
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each of the graphs in Figure V-8, the reader can see 
that the pretest and post-test scores were about the, 
same for each grade level. This may suggest that 
across, rather than within, grade levels, students in 
ECE schools were progressing at about the same rate 
as that reflected by the publishers' norms. Thus, 
two somevyhat confUqtinjg in^etrpr«t^Mop^*;^iwrge • . . 
front tl\e^*p))s; the pretest to*post-test iht'erpr^ta- 
:.tio'n (within school- years) and the. across-grade-. v 
evels interpretatiea (across school years). If the*'., 
ader. makes the most (:onsei^^i'tive inference, that 
e' students in ECE schools were progressing at the 
normative average rate, the graphs reflect a positive 
finding, since, viewed historically, schools with 
student populations similar to those of ECE 
schools tend to ^be below average in reading 
achievement. . , . 

■ The three graphs in Figure V-9 show average'- 
1975-76 reading achievement scores for students in 
all ECE schools, grouped by the' year in which the 
schools ^nt/red ECE : ECE Phase I (wtered £CE in 
1 973-74), ECE PhaSe' 11 (entered ECE in 1 974-75), : 
and ECE Phase III (entered EKE in 1975-76). The 
graphs in Figure V-9 show results similar to those 
in Figure V-S and can be interpreted in^ similar 
fashion. . ' 

Califof-fiia Assessment Program jeadiri^'achiexe-^ 
ment data. Because ECE serves all students jn 
kindergarten through grade three in participating ^ 
schools,, average school California Assessmient Pro- 
gram (CAP) reading scores can also be usfd to 
examine the progress of students in ECE schools in ^ 
leadiijygi achievement. California Assessment Pro-y 
gramy^eJtP) gride' tljree reading a^liievemeht ^coresf 
vvere selected as the most appropriate measure of ^ 
.the effects of ECE on reading achievement. The 
grade three scores seem to be an appropriate 
outcome measure in the sense, that tl\ey refleeVthe 
iperformance of students air the end of their period 
of participation in ECE, which in 1975-76 ranged 
Sxovfx one to three years. It is important to note 
that since ECE^ j^egan 'in -1^7^-74, grade, three 
California . Asse^ment - Program (CAP) data 4 for 
students who hf/e spent a full fquryears (kinder- 
gar tea through ^ade .ifehrSe) in ECE wilt not b^^ 
hie until the consolidatec! report is made for 
976-77 school year. 



e*9 



av 
the' 

The California' Assessnient Program (CAP) jgrade 
two scores and the gain scores from grade two to 
grajie three are use^yl as an ifiterim assessment of 
the'^effects of ECE. These two^ scores are interim 
me^ures'in the sense that they show hoW students 
are^ doing while stiH in ECE. 
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Normally, no single set of figures can provide a 
complete picture of student achievement patterns 
in ECE schools. Accordingly, pie Department 
analyzed California Assessment Program (CAP) 
reading achievement scores from several different 
perspectives, starting from the' very- .sirji pie and 
moving progressively to the more complex. Tlie 

folio wjng»(malyses are-pre^i^.tea: 

, I* ' ■ , ■■ ' } . v,»'' ■ * ' 

' ♦;. hfistorical profijes/of grade' 'two ''and grade 
,' thVee^ reading' ''achievirtient from' 1972-73^- 
througli 1^75-76 for ECE schools, by year of. 
entry into ECE, as well as for nof^-ECE 
schools ' . 

• Longitudinal rea|ling achievement profiles of 
school scores from grade two to grade three/ 

\ for ECE schools, by year of^ntry into ECE/ 
^ and for ^ matched group i^fnon-ECE school 

♦ Changes in* residual- re^mg^ achievemenV 
scores of grade three stude(^^ m\ECE schools^! 
by years of participation in 

Tlt^ reader Should note that all tables except 
Table V- 10 present school reisidual scores in terms 
of -'weiglited averages." Weigliting is a statistical 
technique used to take school size into account in 
computing average scores for groups of schools. 
For example, if studtJnt^scores fo/ two schools were 
being averaged" and School .A had f SO studejjts 
tested and School B ha(J 200 students, tested, the 
average scores from School 6. would^)t5e weiglited 
more heavily than those from School A to allow 
for. the larger number of students tested. Thus, 
weighted averages for large groups of schools 
portray better the average performance of ^Vwt/e/i/^ 
: wit^ those :^ho6\s and dp rj^rt^ortray as \yell the 
performance of the average school within tl|9 
group. On the, other hand, the "unweighted aver- 
age*' scores presented in Table V-lO- tend to reflect 
school performance trends befterjn that the- scores 
v^are not weighted to allow for the different oumber 
of students tested from school to schoolT. The 
statistical procedures used * in . these analyses are 
described fully in Appendix K. 

Historical profiles 'of grade two and grade three 
reading' jicfUeve ment in ECE sthools, W72'73.- 
'through 107S-7^. The first analysis o/tSalifornia 
Assessment Program (CAP) reading achievement 



residual achievement score is^ defined . as the difference 
between a schoors actual score (average Sdbre of its students) and its 
predicted %core. A positive change in residual score indicates 
improvennrent relative to prediction on the basis of the bapkground 
^chara^ristics of the lstudent,f population Negative changes , in'\ 
residtftis indicate^a dedfie in this«relativc ^erfgxjDWnce. 




data represents a sinipk approach to assessing th^ 
relationship of \iCli to grade two and grade three 
reading achievement, l^is historical approacn 
shows how students in liCE schools performed 
oyer the last four -years, before JiC^^ .\vas fhiplb; 
menttfd and in each year as additional, schools 
were phased into-ECH. Separate historical •praftles 
are presented for all schools within each of the 
three phases of ECF, on the basis of year of entry, 
and for all non-ECE schools. Gra^e three scores are 
-sJioW'rt iin ^Tuble y*6* and : grade tyq scores ui;e 
shown in table V-y: tn-both taWes l97i-f()4C0Tk' 
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represent tl^fc percent of questions that students 
answered cjirrectly on the Califpi-nia Assessniant 
Program ftCAPf Reading Test. Scores froni t\ie 
other three years^hiive bejen adjusted soV^jaiJ 
are comparable to rtie ,1975-76 scores, Tliesliadfed 
areas indicate the scores fof tCF. schools. 

At Ipast^hree important: inferencqji.cap^e drawn 
from the diita in Table V-6. Fir^t'. stUid^ 
schools in i tl)e^ a|y;re|iJteJha a hMbry'-of lo^v 
acluJjY^'merit liHbr '^tc^vjh^^ thtt the -feghools 
enter^eil EOF. In each jjeiif the aehie%ement^ scores 
pl(')studert^^~)n tlie scjioois that \yert\§elected to 
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ECE Phdsa II 
(Entered EfE in 1974-75) 
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ECE Phase III 
lEn^red ECE in 1975-76) 




Fig. V-9. Protest and post-test standard scores in reading achievement, by grade Icvet and year of entiy, for all schools 
participatingjn eariy chfldhood education funded . 

- — ^ — ^ — - ■ V . ' . ' « ' . •■ 

NOTE: School scores were Weighted on^the basis of the number of students tested. "Number of schools, by gradfc leveK' indicates the number 
^ of ^hools that reported usable ach'ievement^data for each grade level. ' . 



enter ECt were lower than those of students in 
schools not'seltjcted for ECli. Second, grade three 
wading achievement scores for students in both 
ECEandnon-ECE$chools vycrc virtually unchanged 
over the four-year period. 

The reader can see by looking across each of the 
rows ill Table V-6 tliat the- largest change oVer the 
four-year period was an increase of 0.3, This 
Increase represents an increase of 0.3 percent of 
the questions answered ^Qn^et^y on the California 
Assessment 'Program (CaP) Reading Test by p^r- 
; t4d!ipatirig. ^u3bnt^.. Further analysis of the Cali- 
fornia Assessment Program (CAP) data, however, 
\t!id,igateji.Wlat this relatively ^bk performance iit*- 
atlklig achievpnSnt is the result 9f 



l(.of 



^ grade tl}ree real 



Slwjg acl 



averaging some rathtr posiNye average gaiil^ 
large' group of ECE schools with thcV jjvera^e 
declines of a much smaller gioup af other EC K 
schools. The group of -tCE schools whose students 
seem to have improved most qii grade three CAP 
reading achievement scores is characterized by 
moderate-to-higli scores on the Jjitry Level Test. 
which is given at the beginning of. grade one. Tlie 
group with an average decline on this same test is 
characterized by Entry Level Test scores in the 

. lowest 10 or 20 percent statewide, Tliis char- 
acterization of the\two groups is . not entirely 

•■satisfactory, liQwever. First, tliese scores reflect^ 
only averages of very large ^oups of sc^ioqls^ 
within each of tlie Voups, the iiverlige scores forr 
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Grtde Three CAP Reading A9hicvement Scores for the Years 1^ 2 7 3 Through 1975 '^ 
for Non ECE Schools and Years of Participation for ECE Schools 




iNon-ECE schools 
(N = 2,744) 



A^C>^£^ School scores were weighted on the basisW the number of ilud^ y ^ ^ r 

*Ac|ucvement scores for 1972-73, 1973-74, and 1974-7^ are estimates. The original scores for these years haveT)een adjusted so that they have 
the same mean and standard deviation as the 197)-76 CAP II scores. / ' 
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some schools irarproved, while those of others 
^ declined. Secon(f numerous other meaningful indi- 
cators of how these two groups of pCE schools 
differ from one another may exist. A more 
complete discussion of the performance of sub- 
groups of ECE schools is included in the CAP 
. resicjual scores analyses later in this section. Tliird, 
a very slight overall improvement in sfores-is noted ' 
in ECE schools. In particular, grade three reading 
achievement scores in schools that entered ^'ECE 
three years ago (Phase I schools) declined during;, 
\ the §c^ools' first y^rlrt ^ICE. The scores ynprgved ' 
in, the Schools' secondhand third years in jECE and 
by the third year were.slight}y highe'r thjj^they 
had been before the schools ent^ed E&K The V 
reaoing achievement scpres^in Phase Ii and Phase 
III ^ools. . which entered |CE in 1974-75 and 
1 975*76^Tespectively, ' impr^d slightlyV without 
any initial decBhe,^ 

Table V-7 pre^ts grade two reading achieve- 
ment yores. At least thre^ important inferences 
cari^be drawn fVom the fifeures in Table V-7. Rirst, 
Ihey show that .before ECE schools entered ECE, 
their students scored lower on grade two reading 
achievement tests than students in non-ECE 
schools scored* Second, grade two scores f\Uc- 
tuated more than the girade three scores over the 
four-year period, Third, grade* two scores in ECE 
schools declined slightlj^. In particular, the schools - 
that,^nter«d ECp in J ?73-74X?)ias^ I) experiencjed 
a drop in grade two readingv, achievement. The 
scores in Phase II sch6oIs, which entered ECE in 
1974-75*, declined during the schools* first yeai in 
ECp bi|t ijuproved during the second year tb a * 
point beyond the pre-ECE l6vel. The Phase; III 
schools, which entered ECE/in 1975-76, experi- 
enced a decline in grade twoicores. 

Examined together, t9$les Vl-6 and y-7 Indibate f 
that in ECE schools gradSiwp reading achievement j 
scores haVe been declining slightly and grade three, 
scotes have beeff improying'slightly. This Inference ' 
needs to be quaUfiilwnoW^ver, by drawing atten- ^ 
tion to>the fact that tiie^ho^^ in the three phases 
•of ECE and the rtoi^ECE scnbo4s differ from one ' 
another in terms of a variety of studeht back- 
ground characteristics. Since diFfefenceriri back- 
ground characterisflcs can have a profound impact 
on ;studSnt • achueyement score^ ;the next two 



iyses are di 
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lighed to allow, ror 'adjustments 
rfoi background factors; that is, they 
trgl" of background factors. On the 
the adjustments result in a certain 
tatistical abstraction in program com- 
le focus of the comparisons is no longer 



simply on test scores; it is on scores as they appear 
after adjustments have been made. 

iQngitudinal comparison Q/ hX^E schools and a 
similar group of ^qn-E^CE scfwdls. For a. longitu- 
dinal comparison lof. Ecfe schools with non-ECt 
schools, all schools were blocked on the basis of 
1975-76 data indicating school size, percent of 
minority enrollment, and predicted gradfc three 
reading achievement; and nomEC^ means were, 
compdtett by means of an Accepted statistical, 
procedure^ ^ . , " 

Longitudinal profiles of the three phases Of T^tB 
schools and of the blocked group of non-ECE 
schopls^e preseijte^ in Table VvS. The profiles are 
longitudinal in the sense that they trate the change 
in average school scores from grade two to grade 
*three over the sjjan of one y^^. The firsi column 
in Table V-8 shows California Assessment Program 
(CAP), reading achievement sco^:.es for grade two 
students in 1974-75; The ffecond^cdumn shows the 
scores of grade three students in the same group of 
schools on the identical reading achievement test in 
1975-76.- The third column shows how mych 
. progress was mide from grade two to grade three. 
Several inferences* 'tan he drawn from the figures 
in Table V-8. Students in ECE schools had lower 
grade two reading achievement scores in . 1 974-75 
than . students iiv a similar group of non-ECE 
schools had. When gjrade thfee students in the same . 
schools were tested tTie next year (1975-76), those 
in ECE^ schools continued to 'score lower in the 
absolute than did those Jn the similar group of 
non-ECE - schools. However, longitudinal gain 
sfcores of students in tKe ECE schools were larger 
tnan those of students in the non-ECE schools, 
indicating that greater gains were made in the ECE 
i schools than were made in the ndn-ECE sdhools. 

Oianges in residual reading achievemen\ scores. 
Another approach to^assessing the effectiveness of 
ECE ifi-,to look beybnd'the aggregate performance- 
of Students in ECE schools and examine student 
achievement data for ECE schools with different 
background characteristics. The analyses that fol- 
low contain descriptions of student achievement in 
Various subgrouiis of feCET schools. The reader* 
should view these analyses with caption. First, they 
are much more complex than those typically ; 
presented in progAm evaluation reports because 



All schooLi were blocked into 180 cells (3x3:x20) on the basis 
of three levels of school size, three levels isf percent of minority 
enroUjnent, and 20 labels of ^ade three predicted scqyres. The qieans 
shown in Table V-8 ar^s^igMcd and averaged over the 180 cells. A 
full discussion of the proce^l^^ used is included in the appendix. 
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they require extensive use of data on school 
background factors as well as data on student 
achievement. Second, a detailed technical review of 
Uiese data not yet been completed. Upon 
completion a supxplementary t^chn^-al report will 
,be, provided. These cautions are not meant to 
minimize the imffort^nce of these data; they are 
merely intended!, to'alert the reader to the fact that 
as these analy^;e^ continue, specific conclusions and 
interpretations may become.cjearer. . 

The Department hopes' that these analyi^es can 
be a first step in examiiTing the range of student 
ptu^'ormance levels among KQE schools and that 
stibsequent in-dept|i studies will provide data lead- 
ing to appropriate program nlodification and 
improvement strategies. 

Tables V-9 through V-11 provide an . analysis, 
based on CaliTomia Assessment Program (CAP) 
data, of residual reading achievement scores. Again, 
a resic|ual score is defined as the. difference 
between a schooPs actual score (average score of its 
students) and its predicted score.. Predicted scores 
are statistical estimates based on background char- 
acteristics of the school and its students.® A 



**Thcsc background characterisfics i^^cluded 1973-74 h'ntry L^vel 
Test score,. socioeconomic index, number of students tested, percent 
of students speakmg English only, and mobility rate. 



positive change ih- residual scores indicates 
improvement in performance rv'lalive to predicliort. 
A nf^gative change in residual score6t indica|tes a 
d^cfine in performance relative to j)rediction. ' 

For purposes of determining whether changes in 
residual achieVj^ment were different in schools that 
served pupils with different background character- ^ 
istics, schools were divided intb thrt^tJ^grojUps on 
, the basis of average student performance On the 
' J973-74 Entry Level Test. Wliilc sevctai vitriables 
"Ci^uld have been used as a^asis on whicll'tjb group 
s^iools. Entry Level Test scores were chosen for 
: two reason}*: they relate mbst strongly <o lachieve- 
merft test scores, and they are objective. 

PbT the initial data analysis, ten j gj^oups of 
schools were formed (by decile of 197[3-|74 Entry 
LevA fest scores). Three general patterns/of scores 
wertf notecf ffom an examination of the mean test 
scores for these ten groups of schoqlswone pattern 
for those schools whose students' £>i//fv ^evel Test 
scores ranged from the 1st to the 20th percentiles; 
another for those schools whose stu(]&nts scored 
between the 2 1st and the, 60th percentiles; and a 
third fdr those whose student? score^ t/etween the 
61st and the 99th percentiles. Analysed were done 
for each of the three .groups. Qaua /from those 
analyses are included in tables V-9 ithfough V-1 1. 



fir , TABLE V-8 

Reading A^ievehient Gain Scores for £C£ Schools and Blocked Groups of Non-EC^ Schools, 
1974-75 and 1975-76, from California Assessment Program 



•* 

Jypc of school 


Grade two scores 
1974.75 


Grade three scores 
1975-76 


Gainscorts 
(number correct. 
1975-76. less number 
correct, 1974-75) 


PI last* 1 schools * ' \ 
( riircc yc!trs inYX'l ) 
N - 401 


^ 

(>5.H ^ ■ • J 




■ I4!5 '\ 


« 

Phase II schools 
( Two years in litrii) - 
N = (>35 


65.6 


80.0 




Phase 111 schools 
(Ori^car in ECE^ 
N = 475 


67 ;4** 


80,7 




Non-ECE sch6ols • 
N =5,744 


68.4 


81.7 ' 


IBJ 



NOTE: Schpols were blocked on the basis \ 

school size... 
*Grade two score is prior to entry into £C£, 



predicted grade three scores; (2) minority student erifo(lrnent; and (3). 
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• Tabic V-9 shows the change in residuals, basdd 
on weiglitcd average scores, for. each of the grou|)s 
for one, two, and three years^'of participation in 

Sevc*ral important inferences can be drawn from 
the data in Table V-^), First, the relationship 
between ECE and improved grade three reading 
achievement appears to be much stronger than the 
rejationslup that one notes from examining sta^- 
wide averages atone. In schools whose entering 
students averaged between Hie 21st and the 99th 
percentiles on the X^l^lA Entry Level Test, grade 
three reading achievement improved markedly 
^ beyond predicted levels after three years in ECE. 
Second, in schools whose entering students aver- 
aged below the 20t)i percentile on the 1973-74 
Entry Level Test, grade three reading achievement 
declined relative to prediction after three years in 
ECE. 

The Improvement in residual scores indicates 
that, on the average, ECE seems to be associated 
with improved residual scores in reading in a 
majority of schools-a group of schools whose 
studervfs averaged from the 21st to th'^ 99th 

TABLi:V.9 

Changes in Residual'Scores (Weighted Averages) on 
Grade Three Rdading Achievement Tests After One, 
Two, and Three Years of Participation in ECE, by 
Three Levels of Performance on the 1973 74 
Entry Level Test 



Nmhhcr of years 
mid 


Clianges in residual scqres, 
grouped by percentile rank 
oji P)73-74/fAr 


All ICI 
schools 
(wbigiiteJ 
;4verage) 


1-20 


^-60 


61-99 


One ycnr 


.00 


.OS 


f.0()\ 


.(M) 


Two years 


A S 


+ .05 


+ .00 


.01 


Three years 


-24 


+.19 


+ .18 

- , 


+ .03 



NOTES: Residuals were standardized to have a mean of.zero and a 
standard deviation of one. Changes in residuals after one year of 
BCE were obtained by fust calculating the average residual for ECE 
schools in the year before they entered \^CE. calculating \heit 
average residual in their first year in ECE, and then subtracting Ihe 
former from the latter. Similarly, changes in res^uab after two and 
Itltree years in ECE were obtained by subtracting the preprogram' 
residuals of ECE schools from theicjesiduals after two and three 
years, respectively, in ECE. 

The numbers of students anil schools ip6luded in tablesi V-^ through 
V- 12 varied because of the cUfferenHfumbers of schools invoWed in 
ECE in each year. In all cases tnSmmber of students for whom data 
were analyzed was greater than 6,2O0f 



percentiles on the Entry Level Test. On the otjior 
hand, liCli seems to be associated with declining 
residuals in a much smaller group of schools whose 
iJtudents had lower average levels of learning 
k'adjness when they entered grad/ one. Table V-10 
contains the same data reporlbd in Table V-9, 
except that school scores haveAiot been weigjited 
to allow for different schgol iizes. When viewed 
from tile perspective of average ^school perfor- 
mance, these data lead to somewhat different inter- 
prel^itions. F^^or example, average declines w^c still* 
reflected in schools whose siudcwis'^ Entry Level 
Test scores were in the lowest 20 percent, but the 
declines were neither as consistent nor as sharp as 
those shown in the weiglited averages in Table V-9. 

l Aiai: V-io 

Changes in Residual Scores (Unweighted Averages) on 
Grade Three Reading Achievement Tests After One, 
Two, and Three Years of Participalion in ECE, by 
Three tjcvels of Performance on, the 1 973-74 
" Entry Level Test 





Changes 


in residu 


j| scores. 






grouped by jx'rccntjle rank 


All ICl, 


Number ol 




^)73-74 1:1.1 


schooLs 


years 








(unweighted 


in tCE 


1 20 


21 60 


()L W 


average) 


One year ^ ^ 


V ,04 


.07 


7^ 


.02 


Two .years 


.15 


+ .02 


+.14 


,02 


Three years 


.14 


+,14 


+.M) 


+.02 



NOTES; Residue yftse staj)daidized to have a mean of zero and a 
standard ^deviation of one. Changed in residuals after one year of 
ECE' were obtained by first calculating the average residual for EC I! 
schools in th« ycir before they entered ECE, calculating their 
average residual in their fust year in ECE. and then subtracting the 
former flrom the latter. Similarly, chahgesin residuals after two and 
three years in ECE were obtained by subtracting the preprogram 
residuals of ECE schools from their residuals alter two and three 
years, respectively, in ECE. 

The numbers of students and schools included in tables V-9 through 
V- 1 2 varied because of the different numbers of schools involved in 
ECE in each year. In all cases the number of students for whom dati 
were analyzed was greater than 6,200. 



A comparison of tables V-9 and V- id may 
indicate that larger schools are accounting fpr a 
greater proportion of the decline in residual scores. 
However, this is a preliminary interpretation ^hat 
must be followed up with much more extensive 
analyses of both the California Assessment j^o- 
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gram (CAR) data and other appropriate student 
backgroundland school factors. 

The brewdown of changes in residuals into 
Entry LeveV\Test percentile groups for grade two 
reading scorqs is presented in^T^ble V-1 1. While the 
differences for grade two sccJres among the three 
Entry. Level Test groups were not as sharp as those 
for grade threlp kores, the grade two scores of the 
bottom 20 Mrcent group, in general,' declined 
more than dia the grade two scores of the other^ 
groups. The dc|chne for grade two scores, however,* 
was not as stctep as that for grade three scores. 
These data also seem consistent with the previous 
finding, from \ California Assessment Program 
(CAP) acjual scires, that in many ECE schools an 
initial decline wdt^xperienced in grade two reading 
scores, followed by "a lAarked upturn by the end of 
grade three. This interpretation is supported by the 
foUoWing analysis! in. which the difference between 
grade two and grape three residual scores from one 
year to the next i4 considered. The residual scores 
of 1973-74 ECE^grade two students were sub- 
tracted from the rtsidual scores of 1974-75 grade 
three students from the same schools^ Sinfiilarly, 

Changes in Residual Scores (Weighted Averages) on 
Grade Two Readfaig Achievement Tests After One, 
Two, and Three Yeai% of Participation in ECE, by 
' Three Levels of PeMormance on the 1973-74 
Entry^ Level Test 



Number of years 


Changes in residual scores, 
grouped by percentile rank 
on \913'74tLT 


All ECE 


* in ECE 


1 20 


21 -60 




schools 


One year 


.12 


.17 


-.07 


-.12 


Two years 


.17 


.03 


+.01 


.06 


Three years 


.18 


.12 . 


r .06 


.13 



NOTES: R^duab were standardized to have a mean of zero and a 
'standard deviation of one: Changes in residuals af^r one year of 
ECE were obtained by first calculating the aVerag^tesidual for ECE 
sdioob in the year before they entered ECE, calculating their 
average residual in thei; first year in ECE, and tfien subtracting the, 
former from the latter. Similarly, changes in residuals af«r two and^ 
three years in ECE were obtained by subtracting the preprogram' 
reslditals of ECE schools from their residuab after two and three 
years, resptecttvely, in ECE. 

The numbers of studenU and schools inchided in tables V-9 throu||h 
*V-12 varied t>ecause of the different numbers of schools invoNed in 
Eib£ in each year. In aU cases the number of students for whom daU 
were analyzed was greater than 6,200. 



1974- 75 ECH grade two students' residual scores- 
were also subtracted fropi the residiial scores of 

1975- 76 inide three students from the same 
schools. The corresponding changes for non-ECE 
schools were computed in the same maimer. These 
data arc reported in Table V-1 2. 

TAHLi: V I 2 

Longitudiiud Chinfet (19'^3-74 Through 1975-76) in 
Retkliial Scores (Weighted Arenget) from Grade Two to 
Grade Three fQr ECE and Non-ECE Schoob, by 
Three Levels of Performance on the 1973-74 
Entry Level Test 



Changes in residual scores, grouped 
by percentile rank on \^^1}'14 f.'LT 



Type of school 


1 20 


21 60 


61 9^) 


hCL sclujols ) 




>'26 


+ ,07 


Non-l'C'l: schools 


.10 


f.l 1 


.11 


« 









NOTES: Reiiduah were standardi7.ed to have a mean of zero and a 
standard deviation of one. Changes in residuals after one year of 
ECE were obtained by first calculating the average retidual for ECE 
schools in the year before they entered ECE. calculating their 
average residual in their first year in ECE, and then subtracting the 
former from the latter. Similarly, changes in residuals after two and 
three years in ECE were obtained by subtracting the preprogram 
residuab of ECE schools from their residuals after two and three 
years, respectively, in ECE 

The numbers of students and schools included in tables V-9 through 
V-12 varied because of the different numbers of schools invoked in 
ECE in each y^r. In aU cases the number of stents for<whjpm data 
were analyzed was greater than 6,200. , 

Table V-12 indicate that ECE schools'whose 
students scored from the 21st to the 99 th percen- 
tiles on the^l 973-74 Entry Level Te^t showed 
much larger gains in residual scopes from grade two 
to grade three than .did non-ECE schools^ On the 
other hand, ECE schools whose students s^red in 
the lower range on the 1973-74 Entry Level Test 
showed smaller gains than non-ECE schools 
showfcd from grade two to grade three. It is |lso 
important to note that residual scores for both 
ECE and non-ECE schools between the 1st and 
20th percentiles declined from grade two to grade 
three, although the declines in noh-ECE schools did 
not seem to be as steep. Interestingly, residual 
scores between grade two' and grade three for 
non-ECE/^schools in the upper Entry Level Test 
range/^st to 99th.percentiles) al^o declined. 

'fiiie question of whether the criteria by which 
ECE schools are initially selected may be introduc- 
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ing bias into thcsi? analyses will^ require lurther 
examination. The preliminary ilata shown in I'abic 
V-L^ indicate that within schools whose students* 
Kntry Level Test scores .wei'e in the lowest 20 
percent, schools inchuleil a disproportionate 
share of students who scorcil in tJie lowest 10 
percent on the test. Puis, the apparently steeper 
decline in a'sidual scorv's for liCiv schools may he, 
in part, a result of tlieir overrepresentation in the 
lower end ot; the I to 20 percept Ijitrv. Level Test 
range; and the decline may be as great, or perhaps 
even greater, for similar non-IXM- schools Hie 
similar patterns in Table V-l 1 for non-l C'l: schools 
are a good example ol why these fu/ther analyses 
are necessary, ^ 

' ' rAiii I v-i .; ^ 

Number of Students in EC E and Non ECE Schools 
Scoi^l^ in Percentiles I V20 on the 1973-74 
tniry Levet Test 







ol siiiiionis 


Percentiles 




Non I C 1 


Percentiles 1 10 






Percentiles II 20 


io.7^n) 


17.i4I 



In' j^ummary, the residual clunge analysis, 
althougli still incomplete, hd^ resulted -an the 
isolation 'of stronger , ECE relationships with 
improveraent in rt^ading achievement than were 
apparent in prior analyses. When seJiooJs were 
dy(Vided into three levels of averse Entry Level 
Vest performance, strong positive longitudinal 
changes in grade three residual ,v«fcores were found 
to be associated with ECE schools in the 21st to 
99th . percentile Etitry Level Test range. On the 
other hand, longitudinal declines in average resid- 
ual scores were noted among schools in the I st to - 
20th percentile Entry Level Test range, These ^ 
declines were more marked for ECE than for 
non-ECE schools! Some doubts about the meaning 
of the decline were raised by similar patterns in 
non-ECE schools. The importance of locating more 
precisely^he achievement trends among -subgroups 
pf ECE ^nd non-ECE schook was noted. Other 
preliminary data that were mentioned made con- 
clusive interpretaHons premature. 

Apart fronl the technical issues already 
described, the findings have iihportant implications 
for further study of both ECE and non-ECE 
schools. More thorough studies are -needed of the 
relationships between' changes in residual scores 



And background (actors pi|ier than the AVj/n- Leve\ 
Test scores. It is important to Mi)te Ihat^ although 
subgroups schools were identified on the basis 
ol students' Entry l evel Test performance, each of 
the subgroups includeil a large nui^iber of schools 
with different background characteristics and per- 
formance levels Puis, it may be possible to 
identify from among those student and school 
characteristics lor which data are already available 
those characteristics that seem t6 be associated 
with increasing residual scores ai\d those associated 
with declining residual scores. I'or example; prelim- 
inary analyses indicated that very large schools 
accounted for a disproportion;ire share of declining 
residual scores in the lowest 20 percent Entrv 
Level Test range, even ^Iter appropriate 'a'djust- 
^ ments had been niadc for the number of slbHWi^ts 
involved. Other important variables that Jiavc hot 
yet been examined in depth include the piiopyrtion 
of ilisadvantaged students ariti •limited- arid npn- 
l*nglish-speaking students in/tfie schools iA ques- 
tion. Tl»e results of each 'of these analyses vbill be 
included in. the forthcoming supplementary techni- 
'Cal report. . 

fuirllier analyses of the rejationshp ,of schodi ^ 
bacKgrcaind factors to performance are Jikely' Jig ' 
raise important questions for Held researcl), *On«e 
positiveiirtd negative perforrnahce trends haV6 been ' 
clearly identified and related to school charactef^f, 
tics, specillc educationaP questions can be exam- 
ined-. For example, what are tlie practices ffimt 
seem to be associated with improving;^ performance 
in schools with similar backjg;round ^:haracteristics? 
Do specific practices' thar seem to produce 
improvements in performance in schools wTfth.one ' 
set of background characteristics have little or no 
effect in schools with differentsbackground factors? * 
Wliat •are the effects of summer school program? on 
student acliievement scores? . • 

The most imp<*tant general implication of thjpse > 
findings is that- they suggest the need' to move ' 
beneath the level of statewide or even subgroup* 
analysis of reading achievement ^)erformance : to 
examine the specific school charaGteristii:s an<j., 
practices that are related to. changes, in perroi*- ' 
mance. Studies of this kind will involve time and 
resources. Therefore, in the coming years :^e 
Department's special surveys, which are distribOted. ^ 
with the consohdated evaluation, will focus on 
these questions. The special surveys to be used ft)r - 
next yearns report will provide for a careful analysis 
of several important queitiorfs that are expected to 
arise from further review of fhe -data cj/escribed 
earlier. , . * ' 
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i The reader should bear in mind that all of the 
\ an^Vses^ r^brted in this section focus on only one 
in'dic^toir* of school performance: reading perfor- 
mance on the l^raide two and grade three California 
■ Assessment '^PrQgram Reading Test/ Many wofild 
, argue that irajproving' reading performance is not 
[ the only gpaUor even the ^^yst important goal, of 'j 
] the schools. Thus, as research into the factors that | 
•influence reading * achievement continues, it is 
essential thalji an attempt be made to identify more f 
precisely oth^r school processes and outcome thatf 
may be "considered important. • ' ■ t" 

Mathefnatics, ^Pretest and post-test standard- 
scores w^re calculated ^for ECE students whq 
received instruction in mathematics. The dati 
presented in Figure' V-IO indicate that students i^ 
ECE-only schools scored higher on both the pretes|t 
and the post-test tlf^n did students in schobfe 
funoed by EtE in combination" w.fth other jpr^-" 
grams and that the average post-test 'achievemejdt 
for studetitSj in all EGE schopls was at or above t^e 
national average. | i 

Mathematics: achievement gains for students;,fin 
grades one,! two, and three were also c6htra>&d 
among ECE) schools, grouppd by the year in which 
t the schools (entered ECE. ' . \ n i 



The three graphs in Figure V-1 1 indicate that 
student performance was generally comparable on 
both the pretest and the po^t-test, regardless of' 
when the schpol entered ECE. The reader should 
note, hWever, that students at all grade levels' 
typically attained^ a post-test standard score , in 
mathematics at' or above the natjonal average. 

ESEA TitJelandEDY : ' ' . ' 

ThiiS" section contains information about student 
achievement in Title I-pnly schools, EDY-only 
schools, ancl.title l/EpY-only schools. Reporting 
the data in a single section ^s designed to eliminate 
duplication in reporting, since a vast majority of 
ESEA Title I and/oi" EDY schools received both, 
types of funds. Also, data are presented only , for 
grades one through eight because (1) relatively few 
secondary schools ^conducted programs; and (2) 
out-of-level testing was frequ'ently done at those 
secondary Schools that did conduct programs: The 
reader should note that no -ECE schools are^ 
reported on in this section. * ^ 

Reading. A comparison between pretest and 
P05;t-test standard sfeores in reading for students in 
schools that received only ^SEA Title I or EDY 
funds showed a consistent moVenrnt toward the 
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^ Fig. V'lO. Pretest and post-test standard scores in:inathema(!cs achievement, by grade level, for schools (tarticipating in early 

childhood education funded programs, 1975*76 1 

' " [ \ ■ ' " - - • ■ ' 

■ ^ . ■ i ■ ^ 

f^. NOTE: School scores were weighted on the basis of the number of students tested. **Number of schools, by^grade level'^ indicates the number 



of sch9ols that reported usable achievement data for each ]grade level. 
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national norm. The findings displayed in Figure 
V-12 indicate that-students in grades one through 
four made the Neatest gains ^nd that students in^^ 
grades five throu^ eight tended to have progres- 
sively lower pretest and post-test scores: Analyses 
^ weighted standard score gains revealed that, 
across all grades, students in ESEA Title I-only 
schobis typically gained 3.1 stanAtrd score points; 
stuflents in EDY-bnly schools showed an-increase 
«of j2.8 standard score points; and, as a group, 
students in all combinations of ESEA Title I and 
EJ>Y schools (ESEA Title I only, EDY oitly, and 
ESEA Title I/EDY only gained an average of 2^ 
standard ^oce points. ' ' 



Mathematics: Figure V-13 shows standard scbre^ 
gains in mathematics achievement. The graphs 
indicate that students in ESEA Title I and EDY 
schools Jncreased in position relative to the 
national average at all grade levels. As in reading, 
students in the primary grades made the greatest 
gains» while those in grades five through eight 
tended to have jdeccejeing pretest and post-test 
scores. Compa^pisons by funding source show that 
students in ESEA Title I-only schools, as a group, 
gained 4.3 standard score points; EDY students 
gained an average of 4.0 standard score points; and 
students in all compensatory education schools 
gained^an average of 3.7 standard score points.. 
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• Fig. V-11. Pretest and post-test standard scores irf mathematics achievement, by grade levd and year of entry, for schools 
partidpating in eariy childhood education fimded programs, 19^^ 



NOTE: Schools scores were weighted on the basis of the number of students tested. ^Number of schools, by grade level" indicates the number 
' of schook that reported usable aq|iieveinent data for each grade level. 
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Fig. V-12. Pretest and post-test standard scores in reading achlevemenf, by grade level, for schools participating in ESEA 
Tide tand educationally disadvantaged youth funded programs, 19^^ ; \ ^ 



NOT^. School scores wer^ weighted on the basis of the miihber of students tes^ted. "Number of schools, by grade lever indicates the number 
of schools that -reported usable achievement data for each grade level ^ 
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FigfvAl (continued), ^^and posf^test standard scores in reading achievement, by grade level, f6r schoob pprtiQpating in 
ESEA Title I «nd ^ucationally disadvantaged youth funded programs, 1975-76 ^ 



♦A su^nmary of all combinations of KSEA Title I and educationaSgd^dvantaged youth funding sourees 



^Soht^^l^^^ the basisof the number of sWnts tested. "Number of schools, by grade level^indicates the number 

ot schools that reported usable achievement data for each grade lev6L A « 
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Fig. V-l3.'Prete8t and post-test standard scores in mathematics achievement, by grade levei, for sdiools participating in 
ES^A Titft I and educationally disadvantaged youth funded programs,' 1975-76 



NOTE: School scores were weighted on the basis of the number of students tested. "Number of schools, by grade level" indicates the number 
of schools that reported usable achievement data for each grade level 
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ESEA Title I, Educationally Disadvantaged Youth, 
and £SEA Title l/Edacationally Disadvantaged YQuth* 

Fig. V-1 3 (continued). Pretest and ;post-test; standard scores in nriatheihatics achievement, by grade level, for schools 
participating in ESEA Title I and educationally disadvantaged youth fiinded programs, 1975-76 



, *A summary of all combuiat^ns of DSEA^Titl^ and educationally disadvantaged youth funding sources ^ 

' ^^5* School scores were weighted pn the basis of the number of stuS^nts tested. "Number of schools, by grade lever-indicates the number 
.orschools that reported usable achievement data for each grade level 4 i : , 
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V). ESEA Title I Programs Handicapped StuderUS 
i; ' ^ and Neglected and Delin^quent Youth 



During 1975-76 ESEA Title I funds, were pro- 
vided to serve 86,049 studenrts qualifying for 
special compensatory education 4)rograins. These 
students included 62,000 children of migrant 
workers, 5,023 handicapped students in special 
schools operated by the E)pi)$rtment of Education 
and. in state ho&pitals operated by th^ Depaj^tment 
of Health,' 14,826 neglected^ and delinquent youth 
in local inst^tiitions, 3,886 delinquents in institu- 
tions oper^te^"^ the CaUfofnia Youth Authority, 
and 314 felons in institutions operated by the 



California Department of (Corrections. A separate 
evaluation report on migrant education will include 
information regarding services to migrant students. 
The numbers of participants, by age and grade 
span, excluding migrant students; are- presented in 
Table VI-1. ' ' . / . 

Ptograms for Handicapped Students 

jVThis section contains information about ESEA 
'Title I services that were provided in state special 
schools, in state and local health treatmeip pro- 



TABLE VI-l 



Number of Handicapped Students and Neglected and Delinquent Youth Participa, 
y Prbgrams Funded by ESEA Title 1, 1975-76 



Agency or facility 



Approximate grade level and age ofstuuents/ 



Presicftool ; 
and kinder- 
garten 
. 2-5 yrs. 



Elementary. 

school 
6-^11 yrs. 



Junior 
higli " ' 
school 
I2-I4yrs. 




- High 

school ' 
I5-I8yrs. 



7^duit * 

^ 19-21 yrs. 



Total 



State Department of Education 
Neurologically handicapped 

* Blind 

Deaf . 

State Department of libalth 
Dcvelopmen tally disabled 
Mentally disabled ^ 

UCLA t / ' 

» Neuropsychiatric Institute 

■<J / 

Local educational agencies 

* Neglected and deli{)(^uent 

California Youth Autyority 
Slate Department of' Corrections 



48 
47 
251 



364 
39 



53 



38 
. 29 / 
'2\S 



430 
152 



L876 



L 



Totals 



2,678 



" 31 

4,270 
55 

5,223 



13 
31 

433 



825. 
. 964 



?6 

8,610 
2,658 
35 
13,595 



1 

9 
36 



616 ^ 
149'/ 



: 54 
1,173 
279 
2,317 



100 
121 
940 



2,408 
1,307 



147 

14,826 
^3.886 
314 
24,049 
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gram's,* ana at the Neuropsychiatric Institute at the 
Uniyersit/of California, Los Angeles. * ^ 

' Special ScHpols Progranis 

Six . special state schools administered by the 
Department of Education received ESEA Title I 
funds .during 1975-76 to augment instructional 
programs for* the neurologically handicapped, 
blind, and deaf. A total of 1,161 handicapped 
students in specif schools participated in aug- 
mented msj^ctional programs funded by ESfeA 
Title LliOf that numMp^,'1^0, or 9 percent, were 
neurologically handicapped; 121, or 10 percent, 
were blind; and 940, or 81 percent, were deaf. 
Programs were in Operation between 184 aoi^*206 
school days. jParti^ipan^ts in the schools for neuro- 
logically^ handicapped students attended classes 
^betwerfn three <iid nine months: Students in 
''^hools for the deaf and the blind attended classes 
for the full schopl year. 

Programs at the state-supported schools served 
studen,ts ><rhen local educatiorfal agencies were 
unable 'to meet their specific'* educational needs. 
Services included comprehensive diagnostic evalua-/ 
tions and counseling ' services for parents and 
families of .handicapped student^The schools also 
participated i^i^ cooperative training programs with 
the University of California and\the California 
State University and Colleg^ss systejnrln profes- 
sional internships and toKicher training. 

Funding pjovided by ESEA Title I enabled the 
several special schools to •suppTieijlent their instruc- 
tional . programs in reading, language, and mathe-- 
matics for* the identified target students. Staff 
training, auxiliary services, and parent participation 
activities were adjusted to ►meet the students* ' 
unique needs and circumstances. Student progress 
was xietermined through commercially available 
stamflardized tests, locally developed criterion- 
referenced measures, and observationaf techniques. 

J ' " f 

Dgrams Administered by the California 

bpartment of Health / : « 

ESEA Title 'I allocations tb the California ' 
Department of Health provided"^ for t)>e-establish- 
ment of supplementary educational components in 
state and local health treatment programs. A total 
of 3,715 handicapped students participated* in 
these activities.. Of the student participants 2,408, 
or 64.8 percent, were developmentally disabled, 
those whose special needs resulted from such 
functional impairments as emotional stress, psy- 
chosis, or drug abuse; and Y^,307, or 35.2 per- 
cent, were mentally disabled. Compounding these 




functional limitations for many students were 
fendary handicaps affecting vision, hearing, 
ambulation, and metabolism. Because of the severe 
nature of their emotional disorders, tlie students* 
learning difficulties centered ground reading a^d 
listening, comprehension of wprds and symbol 
and writing^B speaking. 

The Department of Health's programs were 
operated in 1 1 state mental health facilities located 
throughout the state. They operated between 200 
and 365 days,' with an average period tff attendance 
' of x\\xf^ \q 12 months for the developmentally 
disabled and five to eight months for the mentally 
disabled. ' . 

The Department of Education provided support 
in the form of general supervision, coordination, 
VirionitOring, and consulting services; while cppBdi^ 
nators at local facilities prdvided program develop- 
ment, implementation, and evaluation services. 

'Pbe goal of the programs was to raise the 
participants to a level of independence. All ESEA 
Title I. programs administered by the Department 
of Health emphasized language development as the 
primary componeitt, with activities 'in staff 
development and intergroup relations as support 
components; in a fewJacilities participant abilities* 
permitted the use of mathematics as a component. 
Program effectiveness^ was measured fasing either 
rate of ch^ge per unit time in attendance or 
criterion standards for preestablished locally 
developed objectives. Significant injprovement was 
made in all components. The CaUtomia Depart- 
ment of Health publicafnon Z^orrt, Compensatory 
Education Report, 1975-76 contains greater detail 
of these programs and their results! 

UCLA Neurot>sychiatric Institute Program 

The Neuropsychiatric Institute at the University 
of California, Los Angeles, received ESEA Title I 
monies for students with severe handicaps. During 
1975-76 a total of 147 special needs students 
-received augmented- instructional services in this 
inultidisciplihBry hospital setting. All students were 
"admitted to the institute on the basis of medical 
referrals and accompanying problems of personal 
adjustment. The program was designed to meet the 
unique needs of the students in terms of both their 
emotional needs and thei^ academic abilities. 

Programs for Neglected and Delinquent Youth 

ESEA Title I prograips served identified 
neglected and/or delinquent students in a variety 
of special institutions. The programs included 
those administered by local educatioiial agencies. 
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the California Youth Authority, and- the Depart 
ment of Corrections. While complying with condi- 
tions necessarily imposed by the insjitiitij&ns, each 
agency or institution was requireci to develop a 
comprehensive educational plan for its use of 
ESEA Title I funds; this plan included both 
instructional and instructional-support services for 
the* students served > 

Local Educational Agency Programs 

In the 1975-76 school year, 14,826 ESEA Title I 
students were served in ^154 programs for the 
negletted and delinquent administered at the 
school district or county levels. The/npmber of 
students, by grade span and type oflnstitution, is 
presented in Table *y 1-2. 

TJie average length of participation for ne^ected 
■ and 'delinquent 'stfiidehts^j^aried frdtff less than one 
moitth to more than 19 months, with 73 percent 
enrolled in the program for less than six months. 

The primary objectives of'^most programs for 
neglected and delinquent youth were to raise 
academic achievement and to promote attitudinal 
changes, toward themselves, their peers, and the. 
larger society. The most frequently -stated objec- 
tives included impfoving basic study skills, provid- 
ing successful experiences, developing a more 
positive attitude, and reducing the recurrence and 



severity of disciplinary problems. To achieve pro- 
gram objectives, .staffs in thie majority of* institu- 
tions conoentraied on co^selihg -and on a 
.diagnostic/prescriptive instructional^ approach 
related to individual student#eedsi / 

Since the attainment of objectives was depen- 
dent on informed program personnel, most facil- 
ities developed"*' active inservice training activities 
' for their professional and paraprofessional staff. 
These activities were designed to complement the 
ih'tent of the programs by emphasizing instruc- 
tional diagnostic and prescriptive ipethods, use of 
new ' techniques and materials, problems of 
neglected^ and delinquent youth, and ways of 
providing ^ a 'more effecti\fi^ transition for the 
student returning to regular school. These areas 
. were 'addressed in workshops, orientation sessions, 
visits to other programs, conferences, demonstra- 
tions, and work with support service personnel.. 
Regularly scheduled meetings fc^ on-site staff were 
' reported in a majority of the programs. 

Improved student performance in instructional 
areas was generally reported, although the interval 
between pretesting arid post-testing was frequently 
too short, and the numbers of students at particu- 
lar .grade levels were too small to aUow any but the 
? most tentative conclusions. Student results other 
^tl;an academic gains were repo/ted in many 



TABLE VI'2 

Neglected and Delinquent Students in Lpcai Educational Agency Programs 
^ Served by ESEA fitle I. 1975 76 





" Number of students served; by grade level and age of students 






1 ypc i>r 
program * 


Preschool and 
kindergarten 
2 5 years 


„l'.leMicnt'*ary 
6 1 1 years 


Junior jiigli 
school 
^ 12 14 years 


1 ligli scfiool 
15 18 'years 


A, Adult 
J^r 21 years 




Total 


Delinquents in 
court scliools 




M 3 


1,664 


4,500 


47 




6,32^ 


Delinquents not * 
in court scliools 




61 


506 


1,322 


'A : 




\ 


Programs serving 
both neglected 
and delinquent 


4 


a 

343 


3H2 


658 . 






, f 

1,3S7 


Progranjs serving 
only ncglcctcil 


r> 




()5t) 


MM) 


'7 ' 




2/^00 


Tuloriul* 




5^)1 


7.V) 


*)7() 






2,326 


Jokii 




l,H76 


4,270 


H,(>10 


54 


14,H2(> 



♦ I tilorijl jssistjriLv Tor both ncjilcctcd jnd delinquent students in jddilion to tticir rc^uljr school pro^rjin 
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instances and included increased ability to commu- 
nicaite with staff and peers, increased overall 
inotivatipni5 and application of basic skills to areas 
oth|ff^an reading and math. Also m,entibned w^re 
reduSte referrals to the courts and less need for ' 
acjjninistrative discipline. Fof 6lder students more 
intereist in vpcationdl options, was cited as a result 
of career programs. 

Programs Administered by the California Youth 
Authority and the California Department ^ 
of Coffections 

ESEA Title I funds are allocated each year for 
- qualifying students consigned to tlie CaUfomia 
' Yoftth Authority (CYA) from both juvenile and 
criminal courts and for those committed to the 
Department of Corrections from criminal courts. 

All students within these institutions are? eligible 
for service, but because of financial constraints, 
only those persons identified as most in need of 
remedial instruction in reading and mathematics 
are selected for participation in the program. 
Geni^rally, . student? are between sixteen and 
twenty years of age and have showil behavior that 
frequently includes a history of poor school 
experience. Many of the CYA ffarticipants h^e 
come to be regarded as high schopl dropouts. 

During 1975-76, ESEA Title I programs served 
3,886 students in 12 institutions operated by the 
' California Youth Authority and students in three 




institutions operated by the California Department 
of Corrections. 
. The emghasi^Jn ESEA Title I programs in CYA 
institutions 'Was upon diagnostic/prescriptive in- 
struction in reading, language, and mathematics. 
4tistructional methods included small group 
instruction, use of commercially developed media 
materials, and individual tutorirtg. Four schools 
used the individualized manpower training system 
approach to academic skill development. Other 
institutions impleriiented locally developed systems 
designed to meet the needs of the stildents and the 
requirements of their Respective facilities. Use of 
teaching assistants and/or student aides 
reported as an integral part of each ESEA Title-I 
program. 

Schools reported that students in CYA institu- 
tions demonstrated reduced frustration and better 
attitudes' toward school as a result of more 
^stematized diagnostic/ prescriptive instiiiction. 
Schools that placed .heavy emphasis on pro- 
grammed learning reported that students showed 
an increase in autonomous learning, better work* 
habits, and better classroom conduct. Most of the 
schools developed diverse programs to meet the 
needs of.students at different remedial levels. 

In several CYA programs increased participation 
on the part of the total ESEA Title I staff in 
planning the total program was reported. This led 
to better cooperation aiyiong staff and better 
services to students. ^ ^ 
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